00010000:00010000:3.0F:1767316871.236272:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1767316872.261824:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1767316873.300645:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316874.327589:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767316875.336250:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316875.460894:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767316875.460921:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2505:1853163893984512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316875.461152:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893984640:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316875.461210:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767316875.461218:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893984768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316875.461265:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893984896:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316875.461331:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767316875.461338:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893985024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316875.468454:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893985024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316875.468472:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893984896:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316875.474449:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893984640:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316875.474842:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893984768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316875.490020:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2505:1853163893984512:192.168.202.121@tcp:400:kworker.0 00010000:00010000:1.0F:1767316876.356413:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1767316877.270612:0:81807:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 211: mirror delete should not cause bad size ========================================================== 20:21:15 (1767316875) 00010000:00010000:1.0:1767316877.381265:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:2.0:1767316877.416979:0:81818:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316877.417009:0:81818:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316877.417026:0:81818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe04d5aa00/0xd9a0da65fad568e2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abe26 expref: -99 pid: 80760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.417042:0:81818:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe04d5aa00/0xd9a0da65fad568e2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abe26 expref: -99 pid: 80760 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316877.417049:0:81818:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316877.417068:0:81818:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316877.417072:0:81818:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad568e2 00000080:00010000:2.0:1767316877.417265:0:81818:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad568e2 from it ffffa99f41fb7bf8 00010000:00010000:2.0:1767316877.417271:0:81818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe04d5aa00/0xd9a0da65fad568e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abe26 expref: -99 pid: 80760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.417290:0:81818:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe04d5aa00/0xd9a0da65fad568e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abe26 expref: -99 pid: 80760 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316877.417306:0:81818:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316877.417318:0:81818:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316877.417326:0:81818:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316877.417332:0:81818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe04d5aa00/0xd9a0da65fad568e2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abe26 expref: -99 pid: 80760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.417340:0:81818:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe04d5aa00/0xd9a0da65fad568e2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abe26 expref: -99 pid: 80760 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316877.417346:0:81818:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316877.417350:0:81818:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316877.417352:0:81818:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad568e2 00000080:00010000:2.0:1767316877.417356:0:81818:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad568e2 from it ffffa99f41fb7b38 00010000:00010000:2.0:1767316877.417359:0:81818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe04d5aa00/0xd9a0da65fad568e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abe26 expref: -99 pid: 80760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.417365:0:81818:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe04d5aa00/0xd9a0da65fad568e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abe26 expref: -99 pid: 80760 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316877.417372:0:81818:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:2.0:1767316877.417377:0:81818:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), file ffff9cfe0690de00, open_flags c241, mode 81b6 opened 0 00000080:00200000:2.0:1767316877.417386:0:81818:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open|creat 00000002:00010000:2.0:1767316877.417405:0:81818:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f211.sanity-flr,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0141102 00010000:00010000:2.0:1767316877.417417:0:81818:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe04d5aa00/0xd9a0da65fad568e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655abe26 expref: -99 pid: 80760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.417477:0:81818:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe04d5aa00/0xd9a0da65fad568e2 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655abe26 expref: -99 pid: 80760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.417483:0:81818:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767316877.417486:0:81818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe04d5aa00/0xd9a0da65fad568e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655abe26 expref: -99 pid: 80760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.417517:0:81818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81818 initiator: MDT0 00010000:00010000:2.0:1767316877.417524:0:81818:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81818 initiator: MDT0 00000020:00100000:2.0:1767316877.417534:0:81818:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767316877.417546:0:81818:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29109180 x1853163893985280/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2160/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767316877.417555:0:81818:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81818 initiator: MDT0 00000100:00100000:2.0:1767316877.417579:0:81818:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81818:1853163893985280:192.168.202.121@tcp:101:dd.0 00000100:00100000:2.0:1767316877.419131:0:81818:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe111bc180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316877.421897:0:81818:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81818:1853163893985280:192.168.202.121@tcp:101:dd.0 00010000:00010000:1.0:1767316877.421922:0:81818:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.421948:0:81818:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.421957:0:81818:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.421967:0:81818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.421977:0:81818:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.421989:0:81818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.421996:0:81818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.422003:0:81818:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316877.422015:0:81818:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff9cfe29109180 x1853163893985280/t8589937324(8589937324) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2160/664 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316877.422028:0:81818:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29109180 x1853163893985280/t8589937324(8589937324) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2160/664 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316877.422064:0:81818:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316877.422107:0:81818:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.422120:0:81818:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767316877.422127:0:81818:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316877.422151:0:81818:0:(namei.c:1569:ll_create_it()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open|creat 00000080:00200000:1.0:1767316877.422178:0:81818:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00200000:1.0:1767316877.422248:0:81818:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1767316877.422254:0:81818:0:(namei.c:1535:ll_create_node()) setting l_ast_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:1.0:1767316877.422257:0:81818:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad568f0 00000080:00010000:1.0:1767316877.422266:0:81818:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00200008:1.0:1767316877.422282:0:81818:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 141101 00000002:00100000:1.0:1767316877.422303:0:81818:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29109180 x1853163893985280/t8589937324(8589937324) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/664 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767316877.422331:0:81818:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad568f0 from it ffff9cfe09ee9000 00010000:00010000:1.0:1767316877.422335:0:81818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.422344:0:81818:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316877.422364:0:81818:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), inode mode 81a4 mask 40 00000080:00200008:1.0:1767316877.422457:0:81818:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 0, count: 4096 00000080:00200000:1.0:1767316877.422465:0:81818:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:1.0:1767316877.422478:0:81818:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:1.0:1767316877.422485:0:81818:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:1.0:1767316877.422487:0:81818:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 0 0 00000080:00200000:1.0:1767316877.422492:0:81818:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767316877.422505:0:81818:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1767316877.422512:0:81818:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:1.0:1767316877.422515:0:81818:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316877.422530:0:81818:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1767316877.422543:0:81818:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:1.0:1767316877.422547:0:81818:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79ab0, osc lock ffff9cfe09c745f0, flags 0x0 00000080:00200000:1.0:1767316877.422557:0:81818:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000080:00200000:1.0:1767316877.422568:0:81818:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:1.0:1767316877.422617:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1767316877.422619:0:81818:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000020:00010000:1.0:1767316877.422627:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_release():245 00000020:00010000:1.0:1767316877.422630:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316877.422633:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79ab0 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316877.422636:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316877.422639:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79ab0 (ffff9cfe0e4c8128/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316877.422645:0:81818:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:1.0:1767316877.422651:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:1.0:1767316877.422687:0:75366:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe04db6c00 00000008:00100000:1.0:1767316877.422764:0:75366:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe18f3ea00 - object 0x280000400:160 offset 0<>4096 00000100:00100000:0.0:1767316877.422964:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893985408:192.168.202.121@tcp:4:dd.0 00000100:00100000:0.0:1767316877.437890:0:2502:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9cfe08c17800: committing for last_committed 17179875370 gen 1 00000008:00010000:0.0:1767316877.437931:0:2502:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe04db6c00 00000020:00200000:0.0:1767316877.437939:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1767316877.437948:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767316877.437968:0:2502:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe04db6c00 00000100:00100000:0.0:1767316877.437990:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893985408:192.168.202.121@tcp:4:dd.0 00000080:00200000:2.0:1767316877.442296:0:81818:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767316877.442317:0:81818:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316877.442322:0:81818:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767316877.442336:0:81818:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00200000:2.0:1767316877.442340:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316877.442348:0:81818:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:2.0:1767316877.442372:0:81818:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 4096, count: 4096 00000080:00200000:2.0:1767316877.442378:0:81818:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 4096, bytes: 4096 00000080:00200000:2.0:1767316877.442391:0:81818:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767316877.442397:0:81818:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767316877.442399:0:81818:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [4096, 8192) 0 0 00000080:00200000:2.0:1767316877.442402:0:81818:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767316877.442414:0:81818:0:(file.c:2072:ll_file_io_generic()) Range lock [1, 1] 00020000:00200000:2.0:1767316877.442420:0:81818:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 4096 chunk: [4096, 8192) 8192, 4096 00020000:00200000:2.0:1767316877.442423:0:81818:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316877.442438:0:81818:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [1, 1] 00000008:00010000:2.0:1767316877.442451:0:81818:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:2.0:1767316877.442455:0:81818:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fab0, osc lock ffff9cfe2013db50, flags 0x0 00000080:00200000:2.0:1767316877.442463:0:81818:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [4096, 8192) append 0 append lockpos 0 00000080:00200000:2.0:1767316877.442474:0:81818:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), size=4096 (max 603979776), offset=4096=0x1000, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767316877.442515:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316877.442517:0:81818:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 8192 00000020:00010000:2.0:1767316877.442522:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_release():245 00000020:00010000:2.0:1767316877.442525:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.442527:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fab0 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.442529:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316877.442531:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fab0 (ffff9cfe0e4c8128/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316877.442536:0:81818:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767316877.442540:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316877.442572:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45ca80 00000008:00100000:2.0:1767316877.442652:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe29108000 - object 0x280000400:160 offset 4096<>8192 00000100:00100000:3.0:1767316877.443372:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893985536:192.168.202.121@tcp:4:dd.0 00000100:00100000:3.0:1767316877.452296:0:2505:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9cfe08c17800: committing for last_committed 17179875371 gen 1 00000008:00010000:2.0:1767316877.452405:0:2505:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45ca80 00000020:00200000:2.0:1767316877.452412:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767316877.452422:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767316877.452473:0:2505:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45ca80 00000100:00100000:2.0:1767316877.452498:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893985536:192.168.202.121@tcp:4:dd.0 00000080:00200000:3.0:1767316877.452565:0:81818:0:(file.c:2109:ll_file_io_generic()) Range unlock [1, 1] 00000080:00200000:3.0:1767316877.452577:0:81818:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316877.452582:0:81818:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:3.0:1767316877.452596:0:81818:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 8192 i_blocks 16 00000020:00200000:3.0:1767316877.452599:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316877.452608:0:81818:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:3.0:1767316877.452629:0:81818:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 8192, count: 4096 00000080:00200000:3.0:1767316877.452634:0:81818:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 8192, bytes: 4096 00000080:00200000:3.0:1767316877.452642:0:81818:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1767316877.452651:0:81818:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:3.0:1767316877.452653:0:81818:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [8192, 12288) 0 0 00000080:00200000:3.0:1767316877.452657:0:81818:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1767316877.452671:0:81818:0:(file.c:2072:ll_file_io_generic()) Range lock [2, 2] 00020000:00200000:3.0:1767316877.452677:0:81818:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 8192 chunk: [8192, 12288) 12288, 4096 00020000:00200000:3.0:1767316877.452681:0:81818:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767316877.452697:0:81818:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [2, 2] 00000008:00010000:3.0:1767316877.452709:0:81818:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:3.0:1767316877.452714:0:81818:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aae30, osc lock ffff9cfe2004ebe0, flags 0x0 00000080:00200000:3.0:1767316877.452724:0:81818:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [8192, 12288) append 0 append lockpos 0 00000080:00200000:3.0:1767316877.452751:0:81818:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), size=4096 (max 603979776), offset=8192=0x2000, pages 1 (max 147456), lockless, parallel 00000020:00200000:3.0:1767316877.452798:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767316877.452801:0:81818:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 12288 00000020:00010000:3.0:1767316877.452809:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_release():245 00000020:00010000:3.0:1767316877.452812:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316877.452816:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aae30 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316877.452819:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316877.452822:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aae30 (ffff9cfe0e4c8128/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316877.452828:0:81818:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:3.0:1767316877.452834:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767316877.455614:0:75522:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe02e89000 00000008:00100000:3.0:1767316877.455733:0:75522:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe18fd4380 - object 0x280000400:160 offset 8192<>12288 00000100:00100000:3.0:1767316877.455787:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163893985664:192.168.202.121@tcp:4:dd.0 00000100:00100000:3.0:1767316877.465593:0:2504:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9cfe08c17800: committing for last_committed 17179875372 gen 1 00000008:00010000:3.0:1767316877.465623:0:2504:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe02e89000 00000020:00200000:3.0:1767316877.465630:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316877.465636:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316877.465743:0:2504:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe02e89000 00000100:00100000:3.0:1767316877.465763:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163893985664:192.168.202.121@tcp:4:dd.0 00000080:00200000:2.0:1767316877.465861:0:81818:0:(file.c:2109:ll_file_io_generic()) Range unlock [2, 2] 00000080:00200000:2.0:1767316877.465875:0:81818:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316877.465897:0:81818:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767316877.465910:0:81818:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 12288 i_blocks 24 00000020:00200000:2.0:1767316877.465914:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316877.465922:0:81818:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:2.0:1767316877.465949:0:81818:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 12288, count: 4096 00000080:00200000:2.0:1767316877.466031:0:81818:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 12288, bytes: 4096 00000080:00200000:2.0:1767316877.466040:0:81818:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767316877.466048:0:81818:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767316877.466059:0:81818:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [12288, 16384) 0 0 00000080:00200000:2.0:1767316877.466064:0:81818:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767316877.466372:0:81818:0:(file.c:2072:ll_file_io_generic()) Range lock [3, 3] 00020000:00200000:2.0:1767316877.466380:0:81818:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 12288 chunk: [12288, 16384) 16384, 4096 00020000:00200000:2.0:1767316877.466385:0:81818:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316877.466404:0:81818:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [3, 3] 00000008:00010000:2.0:1767316877.466419:0:81818:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:2.0:1767316877.466424:0:81818:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fab0, osc lock ffff9cfe2013db50, flags 0x0 00000080:00200000:2.0:1767316877.466436:0:81818:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [12288, 16384) append 0 append lockpos 0 00000080:00200000:2.0:1767316877.466448:0:81818:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), size=4096 (max 603979776), offset=12288=0x3000, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767316877.466495:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316877.466497:0:81818:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 16384 00000020:00010000:2.0:1767316877.466504:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_release():245 00000020:00010000:2.0:1767316877.466507:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.466509:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fab0 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.466511:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316877.466513:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fab0 (ffff9cfe0e4c8128/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316877.466518:0:81818:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767316877.466522:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316877.466534:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45ca80 00000008:00100000:2.0:1767316877.466613:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe29108000 - object 0x280000400:160 offset 12288<>16384 00000100:00100000:3.0:1767316877.466754:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893985792:192.168.202.121@tcp:4:dd.0 00000100:00100000:3.0:1767316877.479459:0:2505:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9cfe08c17800: committing for last_committed 17179875373 gen 1 00000008:00010000:3.0:1767316877.479502:0:2505:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45ca80 00000020:00200000:3.0:1767316877.479509:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316877.479517:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316877.479541:0:2505:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45ca80 00000100:00100000:3.0:1767316877.479566:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893985792:192.168.202.121@tcp:4:dd.0 00000080:00200000:2.0:1767316877.479682:0:81818:0:(file.c:2109:ll_file_io_generic()) Range unlock [3, 3] 00000080:00200000:2.0:1767316877.479693:0:81818:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316877.479702:0:81818:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767316877.479713:0:81818:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 16384 i_blocks 32 00000020:00200000:2.0:1767316877.479716:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316877.479723:0:81818:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:2.0:1767316877.479747:0:81818:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 16384, count: 4096 00000080:00200000:2.0:1767316877.479752:0:81818:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 16384, bytes: 4096 00000080:00200000:2.0:1767316877.479758:0:81818:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767316877.479774:0:81818:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767316877.479776:0:81818:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [16384, 20480) 0 0 00000080:00200000:2.0:1767316877.479779:0:81818:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767316877.479792:0:81818:0:(file.c:2072:ll_file_io_generic()) Range lock [4, 4] 00020000:00200000:2.0:1767316877.479806:0:81818:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 16384 chunk: [16384, 20480) 20480, 4096 00020000:00200000:2.0:1767316877.479809:0:81818:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316877.479825:0:81818:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [4, 4] 00000008:00010000:2.0:1767316877.479837:0:81818:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:2.0:1767316877.479841:0:81818:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fab0, osc lock ffff9cfe2013db50, flags 0x0 00000080:00200000:2.0:1767316877.479851:0:81818:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [16384, 20480) append 0 append lockpos 0 00000080:00200000:2.0:1767316877.479864:0:81818:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), size=4096 (max 603979776), offset=16384=0x4000, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767316877.479907:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316877.479910:0:81818:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 20480 00000020:00010000:2.0:1767316877.479917:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_release():245 00000020:00010000:2.0:1767316877.479920:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.479923:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fab0 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.479926:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316877.479929:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fab0 (ffff9cfe0e4c8128/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316877.479936:0:81818:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767316877.479941:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316877.480300:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45ce40 00000008:00100000:2.0:1767316877.480373:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe2910aa00 - object 0x280000400:160 offset 16384<>20480 00000100:00100000:3.0:1767316877.480563:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163893985920:192.168.202.121@tcp:4:dd.0 00000100:00100000:3.0:1767316877.499196:0:2504:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9cfe08c17800: committing for last_committed 17179875374 gen 1 00000008:00010000:3.0:1767316877.499963:0:2504:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45ce40 00000020:00200000:3.0:1767316877.499972:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316877.499980:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316877.499996:0:2504:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45ce40 00000100:00100000:3.0:1767316877.500024:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163893985920:192.168.202.121@tcp:4:dd.0 00000080:00200000:2.0:1767316877.500276:0:81818:0:(file.c:2109:ll_file_io_generic()) Range unlock [4, 4] 00000080:00200000:2.0:1767316877.500290:0:81818:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316877.500310:0:81818:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767316877.500322:0:81818:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 20480 i_blocks 40 00000020:00200000:2.0:1767316877.500325:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316877.500333:0:81818:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:2.0:1767316877.500363:0:81818:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 20480, count: 4096 00000080:00200000:2.0:1767316877.500368:0:81818:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 20480, bytes: 4096 00000080:00200000:2.0:1767316877.500376:0:81818:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767316877.500382:0:81818:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767316877.500383:0:81818:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [20480, 24576) 0 0 00000080:00200000:2.0:1767316877.500386:0:81818:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767316877.500397:0:81818:0:(file.c:2072:ll_file_io_generic()) Range lock [5, 5] 00020000:00200000:2.0:1767316877.500402:0:81818:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 20480 chunk: [20480, 24576) 24576, 4096 00020000:00200000:2.0:1767316877.500405:0:81818:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316877.500418:0:81818:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [5, 5] 00000008:00010000:2.0:1767316877.500431:0:81818:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:2.0:1767316877.500435:0:81818:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fab0, osc lock ffff9cfe2013db50, flags 0x0 00000080:00200000:2.0:1767316877.500445:0:81818:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [20480, 24576) append 0 append lockpos 0 00000080:00200000:2.0:1767316877.500468:0:81818:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), size=4096 (max 603979776), offset=20480=0x5000, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767316877.500513:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316877.500515:0:81818:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 24576 00000020:00010000:2.0:1767316877.500521:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_release():245 00000020:00010000:2.0:1767316877.500523:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.500526:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fab0 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.500528:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316877.500530:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fab0 (ffff9cfe0e4c8128/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316877.500535:0:81818:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767316877.500539:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316877.500551:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45ce40 00000008:00100000:2.0:1767316877.500627:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe2910a300 - object 0x280000400:160 offset 20480<>24576 00000100:00100000:3.0:1767316877.501005:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893986048:192.168.202.121@tcp:4:dd.0 00000100:00100000:3.0:1767316877.515768:0:2505:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9cfe08c17800: committing for last_committed 17179875375 gen 1 00000008:00010000:3.0:1767316877.515896:0:2505:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45ce40 00000020:00200000:3.0:1767316877.515905:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316877.515916:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316877.515936:0:2505:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45ce40 00000100:00100000:3.0:1767316877.515962:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893986048:192.168.202.121@tcp:4:dd.0 00000080:00200000:2.0:1767316877.516045:0:81818:0:(file.c:2109:ll_file_io_generic()) Range unlock [5, 5] 00000080:00200000:2.0:1767316877.516067:0:81818:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316877.516129:0:81818:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767316877.516383:0:81818:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 24576 i_blocks 48 00000020:00200000:2.0:1767316877.516388:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316877.516398:0:81818:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:2.0:1767316877.516431:0:81818:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 24576, count: 4096 00000080:00200000:2.0:1767316877.516438:0:81818:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 24576, bytes: 4096 00000080:00200000:2.0:1767316877.516447:0:81818:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767316877.516454:0:81818:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767316877.516456:0:81818:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [24576, 28672) 0 0 00000080:00200000:2.0:1767316877.516460:0:81818:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767316877.516473:0:81818:0:(file.c:2072:ll_file_io_generic()) Range lock [6, 6] 00020000:00200000:2.0:1767316877.516479:0:81818:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 24576 chunk: [24576, 28672) 28672, 4096 00020000:00200000:2.0:1767316877.516483:0:81818:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316877.516499:0:81818:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [6, 6] 00000008:00010000:2.0:1767316877.516513:0:81818:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:2.0:1767316877.516518:0:81818:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fab0, osc lock ffff9cfe2013db50, flags 0x0 00000080:00200000:2.0:1767316877.516528:0:81818:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [24576, 28672) append 0 append lockpos 0 00000080:00200000:2.0:1767316877.516540:0:81818:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), size=4096 (max 603979776), offset=24576=0x6000, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767316877.516581:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316877.516584:0:81818:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 28672 00000020:00010000:2.0:1767316877.516592:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_release():245 00000020:00010000:2.0:1767316877.516595:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.516599:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fab0 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.516602:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316877.516605:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fab0 (ffff9cfe0e4c8128/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316877.516612:0:81818:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767316877.516620:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316877.516636:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45ca80 00000008:00100000:2.0:1767316877.516721:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe2910b100 - object 0x280000400:160 offset 24576<>28672 00000100:00100000:3.0:1767316877.524023:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163893986176:192.168.202.121@tcp:4:dd.0 00000100:00100000:3.0:1767316877.535387:0:2504:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9cfe08c17800: committing for last_committed 17179875376 gen 1 00000008:00010000:3.0:1767316877.535432:0:2504:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45ca80 00000020:00200000:3.0:1767316877.535439:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316877.535448:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316877.535470:0:2504:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45ca80 00000100:00100000:3.0:1767316877.535497:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163893986176:192.168.202.121@tcp:4:dd.0 00000080:00200000:2.0:1767316877.535607:0:81818:0:(file.c:2109:ll_file_io_generic()) Range unlock [6, 6] 00000080:00200000:2.0:1767316877.535620:0:81818:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316877.535639:0:81818:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767316877.535653:0:81818:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 28672 i_blocks 64 00000020:00200000:2.0:1767316877.535657:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316877.535666:0:81818:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:2.0:1767316877.535696:0:81818:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 28672, count: 4096 00000080:00200000:2.0:1767316877.535703:0:81818:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 28672, bytes: 4096 00000080:00200000:2.0:1767316877.535710:0:81818:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767316877.535718:0:81818:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767316877.535721:0:81818:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [28672, 32768) 0 0 00000080:00200000:2.0:1767316877.535725:0:81818:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767316877.535742:0:81818:0:(file.c:2072:ll_file_io_generic()) Range lock [7, 7] 00020000:00200000:2.0:1767316877.535748:0:81818:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 28672 chunk: [28672, 32768) 32768, 4096 00020000:00200000:2.0:1767316877.535752:0:81818:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316877.535767:0:81818:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [7, 7] 00000008:00010000:2.0:1767316877.535782:0:81818:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:2.0:1767316877.535786:0:81818:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fab0, osc lock ffff9cfe2013db50, flags 0x0 00000080:00200000:2.0:1767316877.535795:0:81818:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [28672, 32768) append 0 append lockpos 0 00000080:00200000:2.0:1767316877.535817:0:81818:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), size=4096 (max 603979776), offset=28672=0x7000, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767316877.535861:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316877.535864:0:81818:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 32768 00000020:00010000:2.0:1767316877.535871:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_release():245 00000020:00010000:2.0:1767316877.535875:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.535878:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fab0 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.535880:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316877.535883:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fab0 (ffff9cfe0e4c8128/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316877.535889:0:81818:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767316877.535895:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316877.535909:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45c6c0 00000008:00100000:2.0:1767316877.535987:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe29109880 - object 0x280000400:160 offset 28672<>32768 00000100:00100000:3.0:1767316877.536162:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893986304:192.168.202.121@tcp:4:dd.0 00000100:00100000:3.0:1767316877.554211:0:2505:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9cfe08c17800: committing for last_committed 17179875377 gen 1 00000008:00010000:3.0:1767316877.554248:0:2505:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45c6c0 00000020:00200000:3.0:1767316877.554270:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316877.554278:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316877.554298:0:2505:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45c6c0 00000100:00100000:3.0:1767316877.554320:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893986304:192.168.202.121@tcp:4:dd.0 00000080:00200000:2.0:1767316877.554496:0:81818:0:(file.c:2109:ll_file_io_generic()) Range unlock [7, 7] 00000080:00200000:2.0:1767316877.554510:0:81818:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316877.554523:0:81818:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767316877.554535:0:81818:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 32768 i_blocks 72 00000020:00200000:2.0:1767316877.554538:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316877.554547:0:81818:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:2.0:1767316877.554575:0:81818:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 32768, count: 4096 00000080:00200000:2.0:1767316877.554581:0:81818:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 32768, bytes: 4096 00000080:00200000:2.0:1767316877.554589:0:81818:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767316877.554597:0:81818:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767316877.554599:0:81818:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [32768, 36864) 0 0 00000080:00200000:2.0:1767316877.554602:0:81818:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767316877.554615:0:81818:0:(file.c:2072:ll_file_io_generic()) Range lock [8, 8] 00020000:00200000:2.0:1767316877.554621:0:81818:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 32768 chunk: [32768, 36864) 36864, 4096 00020000:00200000:2.0:1767316877.554625:0:81818:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316877.554639:0:81818:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [8, 8] 00000008:00010000:2.0:1767316877.554652:0:81818:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:2.0:1767316877.554656:0:81818:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fab0, osc lock ffff9cfe2013db50, flags 0x0 00000080:00200000:2.0:1767316877.554666:0:81818:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [32768, 36864) append 0 append lockpos 0 00000080:00200000:2.0:1767316877.554678:0:81818:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), size=4096 (max 603979776), offset=32768=0x8000, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767316877.554720:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316877.554722:0:81818:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 36864 00000020:00010000:2.0:1767316877.554730:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_release():245 00000020:00010000:2.0:1767316877.554733:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.554735:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fab0 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.554738:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316877.554741:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fab0 (ffff9cfe0e4c8128/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316877.554748:0:81818:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767316877.554754:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316877.554766:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45c240 00000008:00100000:2.0:1767316877.555309:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe29109c00 - object 0x280000400:160 offset 32768<>36864 00000100:00100000:3.0:1767316877.555383:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163893986432:192.168.202.121@tcp:4:dd.0 00000100:00100000:3.0:1767316877.568439:0:2504:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9cfe08c17800: committing for last_committed 17179875378 gen 1 00000008:00010000:3.0:1767316877.568479:0:2504:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45c240 00000020:00200000:3.0:1767316877.568486:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316877.568494:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316877.568513:0:2504:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45c240 00000100:00100000:3.0:1767316877.568539:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163893986432:192.168.202.121@tcp:4:dd.0 00000080:00200000:2.0:1767316877.568913:0:81818:0:(file.c:2109:ll_file_io_generic()) Range unlock [8, 8] 00000080:00200000:2.0:1767316877.568927:0:81818:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316877.568947:0:81818:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767316877.568961:0:81818:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 36864 i_blocks 80 00000020:00200000:2.0:1767316877.568965:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316877.568974:0:81818:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:2.0:1767316877.569001:0:81818:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 36864, count: 4096 00000080:00200000:2.0:1767316877.569008:0:81818:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 36864, bytes: 4096 00000080:00200000:2.0:1767316877.569016:0:81818:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767316877.569025:0:81818:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767316877.569028:0:81818:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [36864, 40960) 0 0 00000080:00200000:2.0:1767316877.569032:0:81818:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767316877.569046:0:81818:0:(file.c:2072:ll_file_io_generic()) Range lock [9, 9] 00020000:00200000:2.0:1767316877.569064:0:81818:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 36864 chunk: [36864, 40960) 40960, 4096 00020000:00200000:2.0:1767316877.569068:0:81818:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316877.569129:0:81818:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [9, 9] 00000008:00010000:2.0:1767316877.569156:0:81818:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:2.0:1767316877.569161:0:81818:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fab0, osc lock ffff9cfe2013db50, flags 0x0 00000080:00200000:2.0:1767316877.569171:0:81818:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [36864, 40960) append 0 append lockpos 0 00000080:00200000:2.0:1767316877.569192:0:81818:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), size=4096 (max 603979776), offset=36864=0x9000, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767316877.569240:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316877.569243:0:81818:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 40960 00000020:00010000:2.0:1767316877.569251:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_release():245 00000020:00010000:2.0:1767316877.569254:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.569257:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fab0 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.569260:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284308 (ffff9cfe0e4c8128/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316877.569263:0:81818:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fab0 (ffff9cfe0e4c8128/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316877.569271:0:81818:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767316877.569277:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316877.569294:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45c600 00000008:00100000:2.0:1767316877.569386:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe2910a680 - object 0x280000400:160 offset 36864<>40960 00000100:00100000:3.0:1767316877.569546:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893986560:192.168.202.121@tcp:4:dd.0 00000100:00100000:3.0:1767316877.576389:0:2505:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9cfe08c17800: committing for last_committed 17179875379 gen 1 00000008:00010000:3.0:1767316877.576429:0:2505:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45c600 00000020:00200000:3.0:1767316877.576437:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316877.576445:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316877.576501:0:2505:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45c600 00000100:00100000:3.0:1767316877.576526:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893986560:192.168.202.121@tcp:4:dd.0 00000080:00200000:2.0:1767316877.576687:0:81818:0:(file.c:2109:ll_file_io_generic()) Range unlock [9, 9] 00000080:00200000:2.0:1767316877.576700:0:81818:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316877.576717:0:81818:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767316877.576727:0:81818:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00200000:2.0:1767316877.576730:0:81818:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316877.576737:0:81818:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:2.0:1767316877.576770:0:81818:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 140001 00000002:00100000:2.0:1767316877.576877:0:81818:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe29109180 x1853163893985280/t8589937324(8589937324) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/664 e 0 to 0 dl 1767316893 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767316877.576887:0:81818:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767316877.576890:0:81818:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe2910a680 x1853163893986816/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767316877.576909:0:81818:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81818:1853163893986816:192.168.202.121@tcp:35:dd.0 00000100:00100000:2.0:1767316877.577012:0:81818:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe111bc480 going to sleep for 11 seconds 00000100:00100000:3.0:1767316877.578729:0:81818:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81818:1853163893986816:192.168.202.121@tcp:35:dd.0 00000002:00100000:3.0:1767316877.578752:0:81818:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe29109180 x1853163893985280/t8589937324(8589937324) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/664 e 0 to 0 dl 1767316893 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767316877.587976:0:81820:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316877.588009:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316877.588356:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81820 initiator: MDT0 00010000:00010000:2.0:1767316877.588368:0:81820:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00010000:00010000:2.0:1767316877.588379:0:81820:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00000100:00100000:2.0:1767316877.588408:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893986944:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316877.588557:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe111bcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1767316877.591878:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893986944:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316877.591900:0:81820:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.591909:0:81820:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.591918:0:81820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.591935:0:81820:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.591944:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.591949:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.591954:0:81820:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316877.591961:0:81820:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe29109c00 x1853163893986944/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316893 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316877.591972:0:81820:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.591982:0:81820:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316877.591987:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316877.592009:0:81820:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316877.592013:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad568f7 00000080:00010000:1.0:1767316877.592017:0:81820:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316877.592019:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad568f7 from it ffffa99f41cf3bf8 00010000:00010000:1.0:1767316877.592021:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.592026:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316877.592062:0:81820:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316877.592075:0:81820:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=265 00000080:00200000:1.0:1767316877.592110:0:81820:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), inode mode 81a4 mask 44 00000080:00200008:1.0:1767316877.592121:0:81820:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 154400 00000002:00010000:1.0:1767316877.592148:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114401 00010000:00010000:1.0:1767316877.592335:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.592343:0:81820:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00000020:00100000:1.0:1767316877.592355:0:81820:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316877.592363:0:81820:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3ed80 x1853163893987200/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316877.592372:0:81820:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00000100:00100000:1.0:1767316877.592392:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ed80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893987200:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316877.592608:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316877.595232:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ed80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893987200:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316877.595266:0:81820:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.595276:0:81820:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.595289:0:81820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.595320:0:81820:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316877.595336:0:81820:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe18f3ed80 x1853163893987200/t8589937326(8589937326) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/664 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316877.595349:0:81820:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3ed80 x1853163893987200/t8589937326(8589937326) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/664 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316877.595362:0:81820:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316877.595374:0:81820:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.595382:0:81820:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767316877.595387:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316877.596176:0:81820:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 0 -> 0 00000080:00010000:1.0:1767316877.596300:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad568fe 00000080:00010000:1.0:1767316877.596321:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad568fe from it ffffa99f41cf3bf0 00010000:00010000:1.0:1767316877.596326:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.596336:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767316877.596370:0:81820:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3ed80 x1853163893987200/t8589937326(8589937326) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/664 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316877.596530:0:81820:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1767316877.596539:0:81820:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), xattr lov 00000080:00200008:1.0:1767316877.596565:0:81820:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316877.596572:0:81820:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:1.0:1767316877.596594:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316877.596605:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.596616:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316877.596623:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316877.596629:0:81820:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:1.0:1767316877.596632:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad568f0 00000080:00010000:1.0:1767316877.596637:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad568f0 from it ffffa99f41cf3cd8 00010000:00010000:1.0:1767316877.596640:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.596646:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316877.596663:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1767316877.596673:0:81820:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767316877.596716:0:81820:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316877.596720:0:81820:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79ab0, osc lock ffff9cfe09c745f0, flags 0x400001002 00010000:00010000:1.0:1767316877.596772:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.596790:0:81820:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316877.596893:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893987328:192.168.202.121@tcp:101:lfs.0 00000020:00200000:1.0:1767316877.597214:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316877.599776:0:2503:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316877.599796:0:2503:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316877.599866:0:2503:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316877.599879:0:2503:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316877.599893:0:2503:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 40960, setting rss=40960; kms=40960, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316877.599904:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767316877.599965:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316877.599991:0:2503:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316877.599997:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316877.600005:0:2503:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316877.600025:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893987328:192.168.202.121@tcp:101:lfs.0 00000080:00200000:1.0:1767316877.600121:0:81820:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00010000:1.0:1767316877.600127:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14490 (ffff9cfe0e4c8bd8/0) at cl_lock_release():245 00000020:00010000:1.0:1767316877.600130:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14490 (ffff9cfe0e4c8bd8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316877.600136:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79ab0 (ffff9cfe0e4c8ab8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316877.600140:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14490 (ffff9cfe0e4c8bd8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316877.600144:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79ab0 (ffff9cfe0e4c8bd8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316877.600156:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316877.600210:0:81820:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 154000 00010000:00010000:1.0:1767316877.600246:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316877.600343:0:81820:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316877.600358:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316877.600365:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.600371:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316877.600376:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316877.600382:0:81820:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316877.600384:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad568f7 00000080:00010000:1.0:1767316877.600388:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad568f7 from it ffffa99f41cf3bf8 00010000:00010000:1.0:1767316877.600395:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.600399:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316877.600406:0:81820:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316877.600411:0:81820:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=265 00000080:00200000:1.0:1767316877.600415:0:81820:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), inode mode 81a4 mask 46 00000080:00200008:1.0:1767316877.600421:0:81820:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 1154402 00000002:00010000:1.0:1767316877.600761:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114403 00010000:00010000:1.0:1767316877.600804:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.600811:0:81820:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00000020:00100000:1.0:1767316877.600821:0:81820:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316877.600828:0:81820:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f100 x1853163893987584/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316877.600838:0:81820:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00000100:00100000:1.0:1767316877.600858:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893987584:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316877.601014:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255180 going to sleep for 11 seconds 00000100:00100000:2.0:1767316877.604021:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316877.604719:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939778304 00000100:00100000:3.0:1767316877.604732:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939778304 00000100:00100000:3.0:1767316877.604830:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10164 00000100:00100000:3.0:1767316877.604840:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:51212:x1853163939778304:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316877.604868:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316877.604949:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316877.604956:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:51212:x1853163939778304:12345-192.168.202.121@tcp:104: Request processed in 118us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316877.604963:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10164 00010000:00010000:0.0:1767316877.605018:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316877.605026:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.605035:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05094400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316877.605040:0:63142:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.605048:0:63142:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.605066:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.605119:0:63142:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.605200:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.605207:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316877.605228:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.605234:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094400/0xd9a0da65fad568f0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655abe65 expref: -99 pid: 81818 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.605251:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.605253:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.605255:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316877.605273:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893987712:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316877.609854:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893987584:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316877.609884:0:81820:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.609922:0:81820:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.609930:0:81820:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.609941:0:81820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.609954:0:81820:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.609968:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.609975:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.609982:0:81820:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316877.609995:0:81820:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe18f3f100 x1853163893987584/t8589937327(8589937327) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/664 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316877.610008:0:81820:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f100 x1853163893987584/t8589937327(8589937327) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/664 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316877.610024:0:81820:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.610045:0:81820:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 8 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767316877.610061:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316877.610161:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad5690c 00000080:00010000:1.0:1767316877.610169:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5690c from it ffffa99f41cf3bf0 00010000:00010000:1.0:1767316877.610173:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.610192:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316877.610225:0:81820:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f100 x1853163893987584/t8589937327(8589937327) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/664 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:1.0:1767316877.610302:0:81820:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=800466af arg=7ffd7e9f879c 00000080:00200000:1.0:1767316877.610407:0:81820:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316877.610424:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316877.610433:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.610446:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316877.610453:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316877.610458:0:81820:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316877.610462:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad568f7 00000080:00010000:1.0:1767316877.610465:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad568f7 from it ffffa99f41cf3bf8 00010000:00010000:1.0:1767316877.610468:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.610485:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316877.610493:0:81820:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316877.610510:0:81820:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316877.610517:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316877.610523:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.610530:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316877.610536:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316877.610539:0:81820:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316877.610542:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad568f7 00000080:00010000:1.0:1767316877.610546:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad568f7 from it ffffa99f41cf3b38 00010000:00010000:1.0:1767316877.610549:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.610555:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316877.610562:0:81820:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316877.610568:0:81820:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=. :VOLATILE:0000:7A6034E6:fd=03, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), file ffff9cfe0ea9e480, open_flags 2f9c1, mode 8180 opened 0 00000080:00200000:1.0:1767316877.610574:0:81820:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=. :VOLATILE:0000:7A6034E6:fd=03, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open|creat 00000002:00010000:1.0:1767316877.610594:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: . :VOLATILE:0000:7A6034E6:fd=03,[0x200000405:0x8b:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0574702 00010000:00010000:1.0:1767316877.610613:0:81820:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.610655:0:81820:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.610662:0:81820:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316877.610664:0:81820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad568f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655abec0 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.610698:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.610705:0:81820:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00000020:00100000:1.0:1767316877.610717:0:81820:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316877.610723:0:81820:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3dc00 x1853163893987968/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 552/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316877.610731:0:81820:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00000100:00100000:1.0:1767316877.610752:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893987968:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316877.611029:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255180 going to sleep for 11 seconds 00000100:00100000:0.0:1767316877.611581:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893987712:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316877.614807:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893987968:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316877.614847:0:81820:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.614877:0:81820:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.614905:0:81820:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.614916:0:81820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.614926:0:81820:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.614938:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.614946:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.614953:0:81820:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316877.614964:0:81820:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff9cfe18f3dc00 x1853163893987968/t8589937328(8589937328) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 552/608 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316877.614976:0:81820:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3dc00 x1853163893987968/t8589937328(8589937328) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 552/608 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316877.614989:0:81820:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.615000:0:81820:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/139 (0 0) 00000080:00200000:1.0:1767316877.615007:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316877.615030:0:81820:0:(namei.c:1569:ll_create_it()) VFS Op:name=. :VOLATILE:0000:7A6034E6:fd=03, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open|creat 00000080:00200000:1.0:1767316877.615074:0:81820:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x8b:0x0](ffff9cfe0edb5b88) 00000080:00200000:1.0:1767316877.615098:0:81820:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8b:0x0], updating i_size 0 00000080:00200000:1.0:1767316877.615145:0:81820:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8b:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1767316877.615152:0:81820:0:(namei.c:1535:ll_create_node()) setting l_ast_data to inode [0x200000405:0x8b:0x0](ffff9cfe0edb5b88) 00000080:00010000:1.0:1767316877.615155:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8b:0x0](ffff9cfe0edb5b88) for lock 0xd9a0da65fad56913 00000080:00010000:1.0:1767316877.615165:0:81820:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8b:0x0](ffff9cfe0edb5b88) 00000080:00200008:1.0:1767316877.615499:0:81820:0:(file.c:1001:ll_file_open()) START file . :VOLATILE:0000:7A6034E6:fd=03:[0x200000405:0x8b:0x0](ffff9cfe0edb5b88), flags 574701 00000002:00100000:1.0:1767316877.615524:0:81820:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3dc00 x1853163893987968/t8589937328(8589937328) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 552/608 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767316877.615554:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56913 from it ffff9cfe0f27f8a0 00010000:00010000:1.0:1767316877.615558:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.615567:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316877.615589:0:81820:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8b:0x0](ffff9cfe0edb5b88), inode mode 8180 mask 40 00000080:00200000:1.0:1767316877.615644:0:81820:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8b:0x0](ffff9cfe0edb5b88), inode mode 8180 mask 2 00000080:00200000:1.0:1767316877.615655:0:81820:0:(xattr.c:406:ll_xattr_set()) VFS Op:inode=[0x200000405:0x8b:0x0](ffff9cfe0edb5b88), xattr lov 00000002:00010000:1.0:1767316877.615672:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8b:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:1.0:1767316877.615724:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5691a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.615731:0:81820:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5691a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00000020:00100000:1.0:1767316877.615741:0:81820:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316877.615747:0:81820:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f800 x1853163893988224/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316877.615761:0:81820:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5691a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00000100:00100000:1.0:1767316877.615782:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893988224:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316877.616559:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255180 going to sleep for 11 seconds 00000100:00100000:2.0:1767316877.620746:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316877.620839:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939778432 00000100:00100000:3.0:1767316877.620850:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939778432 00000100:00100000:3.0:1767316877.620905:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10165 00000100:00100000:3.0:1767316877.620916:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15469:x1853163939778432:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316877.620933:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316877.621016:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316877.621023:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15469:x1853163939778432:12345-192.168.202.121@tcp:104: Request processed in 109us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316877.621030:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10165 00010000:00010000:0.0:1767316877.621156:0:63296:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316877.621165:0:63296:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.621173:0:63296:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316877.621178:0:63296:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.621196:0:63296:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.621204:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316877.621243:0:63296:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8b:0x0]: losing layout lock 00010000:00010000:0.0:1767316877.621284:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.621290:0:63296:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316877.621323:0:63296:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.621330:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56913 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655abeff expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.621350:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.621351:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.621353:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316877.621362:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316877.621376:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893988352:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316877.625065:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893988352:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316877.627206:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893988224:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316877.627230:0:81820:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5691a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.627243:0:81820:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5691a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.627249:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5691a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.627255:0:81820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5691a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.627263:0:81820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5691a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.627270:0:81820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2dc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316877.627274:0:81820:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5691a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.627280:0:81820:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5691a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.627287:0:81820:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5691a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.627294:0:81820:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316877.627313:0:81820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5691a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.627321:0:81820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5691a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 81820 initiator: MDT0 00000002:00100000:1.0:1767316877.627349:0:81820:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=800002b, status=0 req@ffff9cfe18f3f800 x1853163893988224/t8589937329(8589937329) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/744 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316877.627361:0:81820:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f800 x1853163893988224/t8589937329(8589937329) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/744 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316877.627379:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316877.627448:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767316877.627457:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316877.627497:0:81820:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8b:0x0], updating i_size 0 00000002:00100000:1.0:1767316877.627514:0:81820:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f800 x1853163893988224/t8589937329(8589937329) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 656/744 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316877.627552:0:81820:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3f800 x1853163893988224/t8589937329(8589937329) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 656/744 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316877.627561:0:81820:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316877.627566:0:81820:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3e300 x1853163893988608/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316877.627586:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893988608:192.168.202.121@tcp:35:lfs.0 00000100:00100000:1.0:1767316877.627664:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255b40 going to sleep for 11 seconds 00000100:00100000:1.0:1767316877.630886:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893988608:192.168.202.121@tcp:35:lfs.0 00000002:00100000:1.0:1767316877.630923:0:81820:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3f800 x1853163893988224/t8589937329(8589937329) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 656/744 e 0 to 0 dl 1767316893 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316877.630981:0:81820:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316877.630989:0:81820:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:1.0:1767316877.631006:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316877.631019:0:81820:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 30 res 8589935621/138 (0 0) 00010000:00010000:1.0:1767316877.631116:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.631126:0:81820:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.631146:0:81820:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00000100:00100000:1.0:1767316877.631167:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893988736:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316877.631305:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255b40 going to sleep for 11 seconds 00000100:00100000:3.0:1767316877.634230:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316877.634477:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939778560 00000100:00100000:2.0:1767316877.634499:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939778560 00000100:00100000:2.0:1767316877.634585:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10166 00000100:00100000:2.0:1767316877.634595:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15469:x1853163939778560:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316877.634613:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.634698:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316877.634705:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15469:x1853163939778560:12345-192.168.202.121@tcp:104: Request processed in 112us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316877.634713:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10166 00010000:00010000:0.0:1767316877.634774:0:49629:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316877.634782:0:49629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.634790:0:49629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316877.634795:0:49629:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.634813:0:49629:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.634832:0:49629:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.634860:0:49629:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.634897:0:49629:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 2/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.634903:0:49629:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316877.634937:0:49629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 1/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.634944:0:49629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad5690c lrc: 0/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655abeea expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.634958:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.634960:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.634962:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316877.634973:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316877.634988:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893988864:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316877.638698:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893988864:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316877.643695:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893988736:192.168.202.121@tcp:101:lfs.0 00010000:00010000:2.0:1767316877.643721:0:81820:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.643734:0:81820:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.643745:0:81820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.643755:0:81820:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.643765:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.643772:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.643795:0:81820:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316877.643814:0:81820:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3d180 x1853163893988736/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316893 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316877.643824:0:81820:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316877.643835:0:81820:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316877.643848:0:81820:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:2.0:1767316877.643854:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767316877.643903:0:81820:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 0 -> 0 00000080:00010000:2.0:1767316877.643908:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad56921 00000080:00010000:2.0:1767316877.643913:0:81820:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:2.0:1767316877.643916:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56921 from it ffffa99f41cf3cd8 00010000:00010000:2.0:1767316877.643919:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316877.643927:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316877.643961:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1767316877.643971:0:81820:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:2.0:1767316877.643989:0:81820:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316877.643991:0:81820:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f130, osc lock ffff9cfe2013db50, flags 0x400001002 00010000:00010000:2.0:1767316877.644014:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.644025:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316877.644036:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316877.644040:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.644046:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316877.644070:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316877.644105:0:81820:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00010000:2.0:1767316877.644109:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d15ff0 (ffff9cfe0e4c8128/0) at cl_lock_release():245 00000020:00010000:2.0:1767316877.644112:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d15ff0 (ffff9cfe0e4c8128/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.644115:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f130 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.644118:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d15ff0 (ffff9cfe0e4c8128/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316877.644121:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f130 (ffff9cfe0e4c8128/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316877.644131:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767316877.644149:0:81820:0:(file.c:6252:ll_getattr_dentry()) START file . :VOLATILE:0000:7A6034E6:fd=03:[0x200000405:0x8b:0x0](ffff9cfe0edb5b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316877.644156:0:81820:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8b:0x0](ffff9cfe0edb5b88),name=. :VOLATILE:0000:7A6034E6:fd=03 00000002:00010000:2.0:1767316877.644170:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8b:0x0]) in obj [0x200000405:0x8b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316877.644222:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81820 initiator: MDT0 00010000:00010000:2.0:1767316877.644237:0:81820:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00010000:00010000:2.0:1767316877.644247:0:81820:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00000100:00100000:2.0:1767316877.644266:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893988992:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316877.644346:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe111bc600 going to sleep for 11 seconds 00000100:00100000:2.0:1767316877.647787:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893988992:192.168.202.121@tcp:101:lfs.0 00010000:00010000:2.0:1767316877.647824:0:81820:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf37 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.647837:0:81820:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf37 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.647848:0:81820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abf37 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.647858:0:81820:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf37 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.647870:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abf37 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.647878:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abf37 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.647885:0:81820:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abf37 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316877.647912:0:81820:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe2910a300 x1853163893988992/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/720 e 0 to 0 dl 1767316893 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316877.647923:0:81820:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf37 expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316877.647935:0:81820:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf37 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316877.647947:0:81820:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/139 (0 0) 00000080:00200000:2.0:1767316877.647953:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8b:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767316877.648004:0:81820:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8b:0x0]: layout version change: 4294967294 -> 1 00000080:00010000:2.0:1767316877.648009:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8b:0x0](ffff9cfe0edb5b88) for lock 0xd9a0da65fad56928 00000080:00010000:2.0:1767316877.648015:0:81820:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8b:0x0](ffff9cfe0edb5b88) 00000080:00010000:2.0:1767316877.648017:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56928 from it ffffa99f41cf3cd8 00010000:00010000:2.0:1767316877.648020:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655abf37 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316877.648028:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abf37 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316877.648070:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8b:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1767316877.648333:0:81820:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8b:0x0] 00000008:00010000:2.0:1767316877.648354:0:81820:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316877.648357:0:81820:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f5b0, osc lock ffff9cfe2013db50, flags 0x400001002 00010000:00010000:2.0:1767316877.648404:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.648414:0:81820:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316877.648457:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1767316877.648518:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767316877.648536:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893989120:192.168.202.121@tcp:101:lfs.0 00010000:00010000:2.0:1767316877.650947:0:2505:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.650970:0:2505:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf3e expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.650982:0:2505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abf3e expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.650993:0:2505:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf3e expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767316877.651009:0:2505:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655abf3e expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316877.651020:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1767316877.651037:0:2505:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abf3e expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.651046:0:2505:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abf3e expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.651063:0:2505:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abf3e expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316877.651192:0:81820:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8b:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1767316877.651199:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d15ff0 (ffff9cfe0e4c8128/0) at cl_lock_release():245 00000020:00010000:1.0:1767316877.651202:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d15ff0 (ffff9cfe0e4c8128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316877.651208:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f5b0 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316877.651212:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d15ff0 (ffff9cfe0e4c8128/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316877.651214:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f5b0 (ffff9cfe0e4c8128/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316877.651227:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8b:0x0] ignore/verify layout 0/1, layout version 1 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:1.0:1767316877.651251:0:81820:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=c00c66f3 arg=7ffd7e9fa8e4 00000002:00010000:1.0:1767316877.651278:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: open flags 01004040000001 00010000:00010000:1.0:1767316877.651339:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56936 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.651346:0:81820:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56936 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00000020:00100000:1.0:1767316877.651367:0:81820:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316877.651378:0:81820:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3ea00 x1853163893989376/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316877.651387:0:81820:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56936 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x81000000000000 pid: 81820 initiator: MDT0 00000100:00100000:1.0:1767316877.651406:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893989376:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316877.651571:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00010000:00010000:2.0:1767316877.652698:0:2505:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abf3e expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767316877.652721:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893989120:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316877.655787:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893989376:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316877.655825:0:81820:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56936 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655abf4c expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.655836:0:81820:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56936 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655abf4c expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.655848:0:81820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56936 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655abf4c expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.655859:0:81820:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56936 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655abf4c expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.655870:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56936 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655abf4c expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.655878:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56936 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655abf4c expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.655904:0:81820:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56936 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655abf4c expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316877.655916:0:81820:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff9cfe18f3ea00 x1853163893989376/t8589937331(8589937331) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/664 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316877.655927:0:81820:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3ea00 x1853163893989376/t8589937331(8589937331) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/664 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316877.655943:0:81820:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56936 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655abf4c expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.655956:0:81820:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 2 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767316877.655962:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1767316877.655983:0:81820:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3ea00 x1853163893989376/t8589937331(8589937331) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/664 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767316877.655992:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad56936 00000080:00010000:1.0:1767316877.655999:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56936 from it ffffa99f41cf3cc0 00010000:00010000:1.0:1767316877.656003:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56936 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655abf4c expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.656010:0:81820:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56936 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655abf4c expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316877.656076:0:81820:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316877.656130:0:81820:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:1.0:1767316877.656145:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316877.656160:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.656171:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316877.656177:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316877.656192:0:81820:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:1.0:1767316877.656196:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad56921 00000080:00010000:1.0:1767316877.656200:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56921 from it ffffa99f41cf3cd8 00010000:00010000:1.0:1767316877.656203:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.656210:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316877.656234:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 1 restore needed 0 00000001:00010000:1.0:1767316877.656245:0:81820:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767316877.656264:0:81820:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316877.656267:0:81820:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79ab0, osc lock ffff9cfe09c745f0, flags 0x400001002 00010000:00010000:1.0:1767316877.656282:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.656291:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316877.656303:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316877.656307:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.656325:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316877.656337:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316877.656347:0:81820:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00010000:1.0:1767316877.656351:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d15ff0 (ffff9cfe0e4c8128/0) at cl_lock_release():245 00000020:00010000:1.0:1767316877.656354:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d15ff0 (ffff9cfe0e4c8128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316877.656357:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79ab0 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316877.656361:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d15ff0 (ffff9cfe0e4c8128/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316877.656364:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79ab0 (ffff9cfe0e4c8128/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316877.656373:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316877.656385:0:81820:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316877.656389:0:81820:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:1.0:1767316877.656396:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316877.656403:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.656411:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316877.656418:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316877.656422:0:81820:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:1.0:1767316877.656424:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad56921 00000080:00010000:1.0:1767316877.656428:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56921 from it ffffa99f41cf3cd8 00010000:00010000:1.0:1767316877.656431:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.656444:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316877.656455:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1767316877.656459:0:81820:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767316877.656465:0:81820:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316877.656467:0:81820:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79ab0, osc lock ffff9cfe09c745f0, flags 0x400001002 00010000:00010000:1.0:1767316877.656475:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.656483:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316877.656491:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316877.656494:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.656502:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316877.656510:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316877.656515:0:81820:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00010000:1.0:1767316877.656517:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d15ff0 (ffff9cfe0e4c8128/0) at cl_lock_release():245 00000020:00010000:1.0:1767316877.656519:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d15ff0 (ffff9cfe0e4c8128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316877.656522:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79ab0 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316877.656524:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d15ff0 (ffff9cfe0e4c8128/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316877.656527:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79ab0 (ffff9cfe0e4c8128/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316877.656538:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:1.0:1767316877.656550:0:81820:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=801066da arg=7ffd7e9fa7e0 00000080:00200000:1.0:1767316877.656557:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316877.656564:0:81820:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:1.0:1767316877.656624:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316877.656642:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893989504:192.168.202.121@tcp:1:lfs.0 00000100:00100000:1.0:1767316877.662308:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893989504:192.168.202.121@tcp:1:lfs.0 00000080:00200000:2.0:1767316877.662643:0:81820:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), inode mode 81a4 mask 4 00000080:00200000:2.0:1767316877.662654:0:81820:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), xattr lov 00000080:00200008:2.0:1767316877.662684:0:81820:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316877.662692:0:81820:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:2.0:1767316877.662711:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316877.662727:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316877.662740:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316877.662748:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316877.662755:0:81820:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:2.0:1767316877.662759:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad56921 00000080:00010000:2.0:1767316877.662766:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56921 from it ffffa99f41cf3cd8 00010000:00010000:2.0:1767316877.662770:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316877.662778:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316877.662977:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1767316877.662995:0:81820:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:2.0:1767316877.663012:0:81820:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316877.663015:0:81820:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f4b0, osc lock ffff9cfe2013ddb0, flags 0x400001002 00010000:00010000:2.0:1767316877.663030:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.663040:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316877.663064:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316877.663068:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.663075:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316877.663355:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316877.663483:0:81820:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00010000:3.0:1767316877.663489:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d15ff0 (ffff9cfe0e4c8128/0) at cl_lock_release():245 00000020:00010000:3.0:1767316877.663492:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d15ff0 (ffff9cfe0e4c8128/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316877.663495:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f4b0 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316877.663499:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d15ff0 (ffff9cfe0e4c8128/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316877.663502:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f4b0 (ffff9cfe0e4c8128/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316877.663518:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316877.707182:0:81820:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: (null) 00000080:00200000:1.0:1767316877.707208:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1767316877.707223:0:81820:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767316877.707250:0:81820:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316877.707255:0:81820:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79ab0, osc lock ffff9cfe09c745f0, flags 0x400001002 00010000:00010000:1.0:1767316877.707280:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.707298:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316877.707313:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316877.707317:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.707326:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316877.707341:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316877.707352:0:81820:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00010000:1.0:1767316877.707366:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14490 (ffff9cfe0e4c8bd8/0) at cl_lock_release():245 00000020:00010000:1.0:1767316877.707368:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14490 (ffff9cfe0e4c8bd8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316877.707372:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79ab0 (ffff9cfe0e4c8ab8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316877.707377:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14490 (ffff9cfe0e4c8bd8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316877.707379:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79ab0 (ffff9cfe0e4c8bd8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316877.707394:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316877.707403:0:81820:0:(file.c:5216:ll_file_seek()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: (null), rc = 40960 00000080:00200008:1.0:1767316877.707408:0:81820:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:1.0:1767316877.707413:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316877.707420:0:81820:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316877.707439:0:81820:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000080:00200000:1.0:1767316877.707446:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316877.707451:0:81820:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1767316877.707454:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316877.707457:0:81820:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316877.707461:0:81820:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:1.0:1767316877.707469:0:81820:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:1.0:1767316877.707471:0:81820:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79ab0, osc lock ffff9cfe09c745f0, flags 0x0 00010000:00010000:1.0:1767316877.707479:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.707488:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.707497:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.707504:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.707518:0:81820:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316877.707528:0:81820:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000100:00100000:0.0:1767316877.707737:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893989632:192.168.202.121@tcp:23:lfs.0 00000100:00100000:0.0:1767316877.710607:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893989632:192.168.202.121@tcp:23:lfs.0 00000020:00010000:2.0:1767316877.710714:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102844e8 (ffff9cfe0e4c8bd8/0) at cl_lock_release():245 00000020:00010000:2.0:1767316877.710718:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102844e8 (ffff9cfe0e4c8bd8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.710724:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79ab0 (ffff9cfe0e4c8ab8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767316877.710734:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.710747:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767316877.710762:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102844e8 (ffff9cfe0e4c8bd8/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316877.710765:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79ab0 (ffff9cfe0e4c8bd8/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316877.710795:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767316877.710819:0:81820:0:(file.c:5216:ll_file_seek()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_HOLE, rc = 40960 00000080:00200080:2.0:1767316877.710849:0:81820:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=66f4 arg=851 00000080:00200008:2.0:1767316877.710868:0:81820:0:(file.c:2474:do_file_read_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 0, count: 67108864 00000080:00200000:2.0:1767316877.710875:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767316877.710890:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316877.710895:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1767316877.710900:0:81820:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:2.0:1767316877.710916:0:81820:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316877.710919:0:81820:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f730, osc lock ffff9cfe2013d0a0, flags 0x400001002 00010000:00010000:2.0:1767316877.710938:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.710949:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316877.710961:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316877.710964:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.710972:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316877.710981:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316877.710988:0:81820:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 40960 i_blocks 88 00000020:00010000:2.0:1767316877.710992:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16da0 (ffff9cfe0e4c8ab8/0) at cl_lock_release():245 00000020:00010000:2.0:1767316877.710994:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16da0 (ffff9cfe0e4c8ab8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.710997:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f730 (ffff9cfe04a6e908/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.711007:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16da0 (ffff9cfe0e4c8ab8/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316877.711009:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f730 (ffff9cfe0e4c8ab8/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316877.711017:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316877.711021:0:81820:0:(file.c:2367:file_read_confine_iter()) f211.sanity-flr: read [0, 67108864] over eof, kms 40960, file_size 40960. 00000080:00200000:2.0:1767316877.711030:0:81820:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: read ppos: 0, bytes: 40960 00000080:00200000:2.0:1767316877.711037:0:81820:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767316877.711043:0:81820:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767316877.711045:0:81820:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 40960) 2048 0 00000080:00200000:2.0:1767316877.711061:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767316877.711070:0:81820:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 9] 00020000:00200000:2.0:1767316877.711077:0:81820:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 40960) 40960, 40960 00020000:00200000:2.0:1767316877.711114:0:81820:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316877.711128:0:81820:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 9] 00000008:00010000:2.0:1767316877.711145:0:81820:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767316877.711148:0:81820:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f730, osc lock ffff9cfe2013d0a0, flags 0x40000 00000080:00200000:2.0:1767316877.711154:0:81820:0:(vvp_io.c:827:vvp_io_read_start()) f211.sanity-flr: read [0, 40960) 00000080:00200000:2.0:1767316877.711160:0:81820:0:(vvp_io.c:886:vvp_io_read_start()) count:40960 iocb pos:0 00000080:00200000:2.0:1767316877.711166:0:81820:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), size=40960 (max 603979776), offset=0=0x0, pages 10 (max 147456), lockless, parallel 00000020:00200000:2.0:1767316877.711223:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 10 items remaining. 00000080:00200000:2.0:1767316877.711227:0:81820:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 40960 count 40960 file_offset 40960 00000020:00010000:2.0:1767316877.711232:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102844e8 (ffff9cfe0e4c8bd8/0) at cl_lock_release():245 00000020:00010000:2.0:1767316877.711234:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102844e8 (ffff9cfe0e4c8bd8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.711236:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f730 (ffff9cfe0e4c8ab8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.711239:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102844e8 (ffff9cfe0e4c8bd8/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316877.711241:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f730 (ffff9cfe0e4c8bd8/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316877.711246:0:81820:0:(vvp_io.c:518:vvp_io_advance()) advancing 40960 bytes 00000020:00200000:2.0:1767316877.711250:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316877.711271:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000008:00100000:2.0:1767316877.711322:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe2910a300 - object 0x280000400:160 offset 0<>40960 00000100:00100000:3.0:1767316877.711683:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767316877.711701:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163893989760:192.168.202.121@tcp:3:lfs.0 00000008:00010000:2.0:1767316877.718394:0:2504:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000020:00200000:2.0:1767316877.718419:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 9 items remaining. 00000020:00200000:2.0:1767316877.718422:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 8 items remaining. 00000020:00200000:2.0:1767316877.718424:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 7 items remaining. 00000020:00200000:2.0:1767316877.718425:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 6 items remaining. 00000020:00200000:2.0:1767316877.718427:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 5 items remaining. 00000020:00200000:2.0:1767316877.718428:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 4 items remaining. 00000020:00200000:2.0:1767316877.718430:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 3 items remaining. 00000020:00200000:2.0:1767316877.718431:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000020:00200000:2.0:1767316877.718433:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000020:00200000:2.0:1767316877.718435:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767316877.718444:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767316877.718590:0:2504:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000100:00100000:2.0:1767316877.718618:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163893989760:192.168.202.121@tcp:3:lfs.0 00000080:00200000:1.0:1767316877.720152:0:81820:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 9] 00000080:00200000:1.0:1767316877.720170:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316877.720176:0:81820:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 1 io complete with rc: 0, result: 40960, restart: 0 00000020:00200000:1.0:1767316877.720189:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316877.720207:0:81820:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 40960 00000080:00200008:1.0:1767316877.720237:0:81820:0:(file.c:2648:do_file_write_iter()) START file . :VOLATILE:0000:7A6034E6:fd=03:[0x200000405:0x8b:0x0], ppos: 0, count: 40960 00000080:00200000:1.0:1767316877.720245:0:81820:0:(file.c:1994:ll_file_io_generic()) . :VOLATILE:0000:7A6034E6:fd=03: write ppos: 0, bytes: 40960 00000080:00200000:1.0:1767316877.720256:0:81820:0:(file.c:1759:ll_io_set_mirror()) . :VOLATILE:0000:7A6034E6:fd=03: desiginated mirror: 0 00000020:00200000:1.0:1767316877.720265:0:81820:0:(cl_io.c:214:cl_io_rw_init()) header@000000001181353d[0x4, 2, [0x200000405:0x8b:0x0] hash] 00000020:00200000:1.0:1767316877.720267:0:81820:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 40960) 2048 0 00000080:00200000:1.0:1767316877.720271:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8b:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767316877.720286:0:81820:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 9] 00020000:00200000:1.0:1767316877.720293:0:81820:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 40960) 40960, 40960 00020000:00200000:1.0:1767316877.720296:0:81820:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316877.720315:0:81820:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 9] 00000008:00010000:1.0:1767316877.720330:0:81820:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:1.0:1767316877.720335:0:81820:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c75c80, flags 0x40000 00000080:00200000:1.0:1767316877.720346:0:81820:0:(vvp_io.c:1312:vvp_io_write_start()) . :VOLATILE:0000:7A6034E6:fd=03: write [0, 40960) append 0 append lockpos 0 00000002:00010000:1.0:1767316877.720388:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x8b:0x0], intent: getxattr flags 0 00010000:00010000:1.0:1767316877.720451:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.720900:0:81820:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00010000:00010000:1.0:1767316877.720913:0:81820:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00000100:00100000:0.0:1767316877.721028:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893989888:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316877.721201:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21b40 going to sleep for 11 seconds 00000100:00100000:0.0:1767316877.724732:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893989888:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316877.724760:0:81820:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf6f expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.724774:0:81820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abf6f expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.724784:0:81820:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf6f expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316877.724797:0:81820:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=80 disposition=0, status=0 req@ffff9cfe18f3c700 x1853163893989888/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 568/1152 e 0 to 0 dl 1767316893 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316877.724808:0:81820:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf6f expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.724822:0:81820:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/139 (0 0) 00000080:00200000:0.0:1767316877.724828:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x8b:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1767316877.724852:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8b:0x0](ffff9cfe0edb5b88) for lock 0xd9a0da65fad5693d 00000080:00010000:0.0:1767316877.724861:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5693d from it ffffa99f41cf38f8 00010000:00010000:0.0:1767316877.724865:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abf6f expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.724873:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf6f expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316877.724911:0:81820:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8b:0x0](ffff9cfe0edb5b88), size=40960 (max 603979776), offset=0=0x0, pages 10 (max 147456), lockless, parallel 00000020:00200000:0.0:1767316877.724989:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 10 items remaining. 00000080:00200000:0.0:1767316877.725006:0:81820:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 40960 count 40960 file_offset 40960 00000080:00200000:0.0:1767316877.725025:0:81820:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8b:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1767316877.725030:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102844e8 (ffff9cfe0e4c8bd8/0) at cl_lock_release():245 00000020:00010000:0.0:1767316877.725034:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102844e8 (ffff9cfe0e4c8bd8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316877.725037:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8ab8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316877.725041:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102844e8 (ffff9cfe0e4c8bd8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316877.725043:0:81820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8bd8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316877.725064:0:81820:0:(vvp_io.c:518:vvp_io_advance()) advancing 40960 bytes 00000020:00200000:0.0:1767316877.725071:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1767316877.725223:0:78255:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe21417540 00000008:00100000:0.0:1767316877.725322:0:78255:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe191d8e00 - object 0x2c0000400:159 offset 0<>40960 00000100:00100000:0.0:1767316877.725361:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316877.725377:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893990016:192.168.202.121@tcp:4:lfs.0 00000100:00100000:3.0:1767316877.737621:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316877.737746:0:42040:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767316877.737765:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939778688 00000100:00100000:2.0:1767316877.737775:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939778688 00000100:00100000:2.0:1767316877.737838:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10167 00000100:00100000:2.0:1767316877.737848:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe05535850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36248:x1853163939778688:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316877.737865:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655abf3e expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.737949:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316877.737956:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe05535850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36248:x1853163939778688:12345-192.168.202.121@tcp:104: Request processed in 109us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316877.737963:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10167 00010000:00010000:0.0:1767316877.743234:0:63143:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316877.743248:0:63143:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655abf3e expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316877.743261:0:63143:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05094200 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316877.743268:0:63143:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x863eb2f6655abf3e expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316877.743290:0:63143:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767316877.743304:0:63143:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1767316877.743365:0:63143:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655abf3e expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316877.743372:0:63143:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316877.743411:0:63143:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655abf3e expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316877.743433:0:63143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad5692f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655abf3e expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316877.743453:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1767316877.743457:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.743459:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.743461:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316877.743488:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893990144:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316877.750924:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893990144:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316877.760141:0:2502:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff9cfe08c17800: committing for last_committed 25769805114 gen 1 00000008:00010000:0.0:1767316877.760182:0:2502:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe21417540 00000020:00200000:0.0:1767316877.760189:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 9 items remaining. 00000020:00200000:0.0:1767316877.760192:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 8 items remaining. 00000020:00200000:0.0:1767316877.760194:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 7 items remaining. 00000020:00200000:0.0:1767316877.760196:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 6 items remaining. 00000020:00200000:0.0:1767316877.760197:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 5 items remaining. 00000020:00200000:0.0:1767316877.760199:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 4 items remaining. 00000020:00200000:0.0:1767316877.760201:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 3 items remaining. 00000020:00200000:0.0:1767316877.760203:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000020:00200000:0.0:1767316877.760205:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000020:00200000:0.0:1767316877.760206:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1767316877.760217:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767316877.760242:0:2502:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe21417540 00000100:00100000:0.0:1767316877.760266:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893990016:192.168.202.121@tcp:4:lfs.0 00000080:00200000:2.0:1767316877.760333:0:81820:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 9] 00000080:00200000:2.0:1767316877.760345:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8b:0x0] ignore/verify layout 0/0, layout version 1 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316877.760351:0:81820:0:(file.c:2142:ll_file_io_generic()) . :VOLATILE:0000:7A6034E6:fd=03: 2 io complete with rc: 0, result: 40960, restart: 0 00000080:00200000:2.0:1767316877.760364:0:81820:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8b:0x0] updating i_size 40960 i_blocks 80 00000020:00200000:2.0:1767316877.760382:0:81820:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316877.760390:0:81820:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 40960 00000080:00200000:2.0:1767316877.760415:0:81820:0:(file.c:5319:ll_fsync()) VFS Op:inode=[0x200000405:0x8b:0x0](ffff9cfe0edb5b88), start 0, end 9223372036854775807, datasync 0 00000100:00100000:2.0:1767316877.760478:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910ad80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893990272:192.168.202.121@tcp:44:lfs.0 00000100:00100000:2.0:1767316877.760557:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe111bc000 going to sleep for 11 seconds 00000100:00100000:0.0:1767316877.774581:0:81820:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937331 gen 1 00000100:00100000:0.0:1767316877.774621:0:81820:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe18f3ed80 x1853163893987200/t8589937326(8589937326) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/664 e 0 to 0 dl 1767316893 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767316877.774634:0:81820:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe18f3f100 x1853163893987584/t8589937327(8589937327) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/664 e 0 to 0 dl 1767316893 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767316877.774674:0:81820:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe18f3dc00 x1853163893987968/t8589937328(8589937328) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 552/608 e 0 to 0 dl 1767316893 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767316877.774721:0:81820:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe18f3ea00 x1853163893989376/t8589937331(8589937331) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/664 e 0 to 0 dl 1767316893 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767316877.774732:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910ad80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893990272:192.168.202.121@tcp:44:lfs.0 00000080:00200000:0.0:1767316877.774756:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8b:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316877.774768:0:81820:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:0.0:1767316877.774856:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316877.774874:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893990400:192.168.202.121@tcp:16:lfs.0 00000100:00100000:0.0:1767316877.783814:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893990400:192.168.202.121@tcp:16:lfs.0 00000080:00200000:2.0:1767316877.783893:0:81820:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8b:0x0] updating i_size 40960 i_blocks 80 00000080:00200000:2.0:1767316877.783908:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8b:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:3.0:1767316877.801834:0:81820:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=801066da arg=7ffd7e9fa7e0 00000080:00200000:3.0:1767316877.801858:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767316877.801871:0:81820:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:2.0:1767316877.801981:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163893990528:192.168.202.121@tcp:1:lfs.0 00000100:00100000:2.0:1767316877.806988:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163893990528:192.168.202.121@tcp:1:lfs.0 00000080:00200008:3.0:1767316877.807345:0:81820:0:(llite_lib.c:2314:ll_setattr_raw()) START file . :VOLATILE:0000:7A6034E6:fd=03:[0x200000405:0x8b:0x0](ffff9cfe0edb5b88) current size 40960, valid attrs 101f0, mode 0, uid 6195, gid 4, new size 4294967296, atime 1767316877.000000000, mtime 1767316877.000000000, ctime 1767316877.000000000 00010000:00010000:3.0:1767316877.807382:0:81820:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655abf37 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316877.807406:0:81820:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8b:0x0]: losing layout lock 00010000:00010000:3.0:1767316877.807451:0:81820:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655abf37 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316877.807535:0:81820:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767316877.807538:0:81820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56928 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655abf37 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000020:00100000:3.0:1767316877.807558:0:81820:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1767316877.807566:0:81820:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18fd7480 x1853163893990784/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767316877.807589:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893990784:192.168.202.121@tcp:36:lfs.0 00000100:00100000:3.0:1767316877.807718:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316877.811684:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893990784:192.168.202.121@tcp:36:lfs.0 00000080:00200000:0.0:1767316877.811734:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8b:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:0.0:1767316877.811757:0:81820:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 31 res 8589935621/139 (0 0) 00000080:00010000:0.0:1767316877.811769:0:81820:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8b:0x0](ffff9cfe0edb5b88) 00000002:00010000:0.0:1767316877.811780:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8b:0x0]) in obj [0x200000405:0x8b:0x0], intent: layout flags 0 00010000:00010000:0.0:1767316877.811842:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81820 initiator: MDT0 00010000:00010000:0.0:1767316877.811851:0:81820:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00010000:00010000:0.0:1767316877.811861:0:81820:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00000100:00100000:0.0:1767316877.811881:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893990912:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316877.812117:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316877.815190:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893990912:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316877.815219:0:81820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.815233:0:81820:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316877.815246:0:81820:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe191d8e00 x1853163893990912/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/480 e 0 to 0 dl 1767316893 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316877.815257:0:81820:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767316877.815270:0:81820:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.815282:0:81820:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/139 (0 0) 00000080:00200000:0.0:1767316877.815289:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8b:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316877.815306:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8b:0x0](ffff9cfe0edb5b88) for lock 0xd9a0da65fad56944 00000080:00010000:0.0:1767316877.815314:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56944 from it ffffa99f41cf3a78 00010000:00010000:0.0:1767316877.815317:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.815325:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.815346:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.815376:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316877.815385:0:81820:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8b:0x0](00000000d688930e) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316877.815423:0:81820:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8b:0x0]: layout version change: 4294967294 -> 1 00010000:00010000:0.0:1767316877.815429:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.815436:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00020000:00200000:0.0:1767316877.815628:0:81820:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:1.0:1767316877.815807:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893991040:192.168.202.121@tcp:2:lfs.0 00000100:00100000:1.0:1767316877.819777:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893991040:192.168.202.121@tcp:2:lfs.0 00000080:00200000:0.0:1767316877.820125:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8b:0x0] ignore/verify layout 0/0, layout version 1 need write layout 0, restore needed 0, invalidate_lock 0 00800000:00000080:0.0:1767316877.820152:0:81820:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9cfe08c17800: cmd=401866d4 len=384 karg=ffff9cfe048c8a00 uarg=0000000000000000 00000002:00000080:0.0:1767316877.820166:0:81820:0:(mdc_request.c:2279:mdc_iocontrol()) lustre-MDT0000-mdc-ffff9cfe08c17800: cmd=401866d4 len=384 karg=ffff9cfe048c8a00 uarg=0000000000000000 00000020:00100000:0.0:1767316877.820195:0:81820:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 55, max 7 00000100:00100000:0.0:1767316877.820205:0:81820:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9880 x1853163893991296/t0(0) o55->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 472/224 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316877.820233:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893991296:192.168.202.121@tcp:55:lfs.0 00000100:00100000:0.0:1767316877.820321:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21a80 going to sleep for 11 seconds 00000100:00100000:3.0:1767316877.828917:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316877.829335:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939778816 00000100:00100000:2.0:1767316877.829345:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939778816 00000100:00100000:2.0:1767316877.829409:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10168 00000100:00100000:2.0:1767316877.829420:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939778816:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316877.829437:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655abf6f expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316877.829534:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316877.829542:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939778816:12345-192.168.202.121@tcp:104: Request processed in 124us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316877.829550:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10168 00010000:00010000:0.0:1767316877.830639:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316877.830651:0:59093:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655abf6f expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.830686:0:59093:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316877.830691:0:59093:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655abf6f expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.830700:0:59093:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655abf6f expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.830707:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655abf6f expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.830762:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655abf6f expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.830769:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316877.830807:0:59093:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655abf6f expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.830815:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad5693d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8b:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655abf6f expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316877.830830:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.830832:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.830834:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316877.830884:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316877.830905:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893991424:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316877.836268:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893991424:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316877.839352:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893991296:192.168.202.121@tcp:55:lfs.0 00000080:00200008:1.0:1767316877.839516:0:81820:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file . :VOLATILE:0000:7A6034E6:fd=03:[0x200000405:0x8b:0x0](ffff9cfe0edb5b88) current size 40960, valid attrs 101f0, mode 0, uid 6195, gid 4, new size 4294967296, atime 1767316877.000000000, mtime 1767316877.000000000, ctime 1767316877.000000000, rc 0 00000080:00200008:1.0:1767316877.839546:0:81820:0:(llite_lib.c:2314:ll_setattr_raw()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) current size 40960, valid attrs 101f0, mode 0, uid 6195, gid 4, new size 4294967296, atime 1767316877.000000000, mtime 1767316877.000000000, ctime 1767316877.000000000 00010000:00010000:1.0:1767316877.839586:0:81820:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.839610:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.839666:0:81820:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.839673:0:81820:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316877.839676:0:81820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56921 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655abf29 expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767316877.839717:0:81820:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316877.839726:0:81820:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3e680 x1853163893991680/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316877.839750:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893991680:192.168.202.121@tcp:36:lfs.0 00000100:00100000:1.0:1767316877.839978:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316877.845822:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893991680:192.168.202.121@tcp:36:lfs.0 00000080:00200000:1.0:1767316877.845872:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316877.845888:0:81820:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:1.0:1767316877.846014:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893991808:192.168.202.121@tcp:2:lfs.0 00000100:00100000:1.0:1767316877.849031:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893991808:192.168.202.121@tcp:2:lfs.0 00000080:00200000:3.0:1767316877.849503:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767316877.849537:0:81820:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) current size 40960, valid attrs 101f0, mode 0, uid 6195, gid 4, new size 4294967296, atime 1767316877.000000000, mtime 1767316877.000000000, ctime 1767316877.000000000, rc 0 00000080:00200080:3.0:1767316877.849565:0:81820:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=c00c66f3 arg=11fa530 00010000:00010000:3.0:1767316877.849619:0:81820:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56936 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x863eb2f6655abf4c expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316877.849638:0:81820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56936 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x863eb2f6655abf4c expref: -99 pid: 81820 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316877.849657:0:81820:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3ea00 x1853163893989376/t8589937331(8589937331) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/664 e 0 to 0 dl 1767316893 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767316877.849668:0:81820:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767316877.849673:0:81820:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18fd4000 x1853163893992064/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767316877.849698:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893992064:192.168.202.121@tcp:35:lfs.0 00000100:00100000:3.0:1767316877.850076:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316877.857587:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316877.857663:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939778944 00000100:00100000:3.0:1767316877.857674:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939778944 00000100:00100000:3.0:1767316877.857732:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10169 00000100:00100000:3.0:1767316877.857742:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15470:x1853163939778944:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316877.857761:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316877.857848:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316877.857856:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15470:x1853163939778944:12345-192.168.202.121@tcp:104: Request processed in 115us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316877.857880:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10169 00010000:00010000:0.0:1767316877.857939:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316877.857948:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.857971:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316877.857976:0:42049:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.857985:0:42049:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.857993:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316877.858107:0:42049:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3ed80 x1853163893987200/t8589937326(8589937326) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/664 e 0 to 0 dl 1767316893 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316877.858121:0:42049:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1767316877.858127:0:42049:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9880 x1853163893992320/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316877.858366:0:42049:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_02:9a586faf-b087-472d-9665-d3bc7d15b908:42049:1853163893992320:192.168.202.121@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1767316877.858422:0:42049:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316877.862879:0:42049:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_02:9a586faf-b087-472d-9665-d3bc7d15b908:42049:1853163893992320:192.168.202.121@tcp:35:ldlm_bl.0 00000002:00100000:0.0:1767316877.862917:0:42049:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3ed80 x1853163893987200/t8589937326(8589937326) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/664 e 0 to 0 dl 1767316893 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316877.862959:0:42049:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:0.0:1767316877.863120:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.863137:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316877.863171:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.863180:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad568fe lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655abece expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.863203:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.863205:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.863207:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316877.863350:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893992448:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316877.866653:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316877.866753:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939779072 00000100:00100000:3.0:1767316877.866762:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939779072 00000100:00100000:3.0:1767316877.866824:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10170 00000100:00100000:3.0:1767316877.866834:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15470:x1853163939779072:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316877.866850:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316877.866930:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316877.866937:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15470:x1853163939779072:12345-192.168.202.121@tcp:104: Request processed in 105us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316877.866944:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10170 00010000:00010000:0.0:1767316877.867007:0:42048:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316877.867014:0:42048:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.867023:0:42048:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037de00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316877.867028:0:42048:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.867037:0:42048:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.867045:0:42048:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316877.867111:0:42048:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8b:0x0]: losing layout lock 00010000:00010000:0.0:1767316877.867161:0:42048:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.867169:0:42048:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316877.867185:0:42048:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.867210:0:42048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56944 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8b:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655abf8b expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.867231:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.867233:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.867234:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316877.869419:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893992448:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316877.869451:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316877.869474:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893992576:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316877.873523:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893992576:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316877.884953:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893992064:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316877.885381:0:81820:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3ea00 x1853163893989376/t8589937331(8589937331) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/664 e 0 to 0 dl 1767316893 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767316877.885432:0:81820:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000002:00010000:0.0:1767316877.885442:0:81820:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: layout flags 0 00010000:00010000:0.0:1767316877.885567:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81820 initiator: MDT0 00010000:00010000:0.0:1767316877.885578:0:81820:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00010000:00010000:0.0:1767316877.885589:0:81820:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81820 initiator: MDT0 00000100:00100000:0.0:1767316877.885611:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893992704:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316877.885749:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316877.895318:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893992704:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316877.895351:0:81820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.895367:0:81820:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316877.895403:0:81820:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe191daa00 x1853163893992704/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/584 e 0 to 0 dl 1767316893 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316877.895414:0:81820:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767316877.895428:0:81820:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.895440:0:81820:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767316877.895446:0:81820:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316877.895464:0:81820:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad5694b 00000080:00010000:0.0:1767316877.895473:0:81820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5694b from it ffffa99f41cf3bc8 00010000:00010000:0.0:1767316877.895476:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.895485:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.895509:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.895520:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316877.895528:0:81820:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](00000000c42cc73a) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.895563:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.895576:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316877.895591:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316877.895601:0:81820:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316877.895627:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1767316877.895637:0:81820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.895645:0:81820:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316877.895652:0:81820:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](00000000c42cc73a) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316877.895665:0:81820:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316877.895681:0:81820:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316877.895688:0:81820:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1767316877.895700:0:81820:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 40960 blocks 88 [cma]time: 1767316877 1767316877 0 by oinfo size 40960 blocks 88 [cma]time 1767316877 1767316877 1767316877 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316877.895755:0:81820:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4294967294 -> 1 00010000:00010000:0.0:1767316877.895759:0:81820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316877.895766:0:81820:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316877.896064:0:81820:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 1154002 00000002:00100000:0.0:1767316877.896170:0:81820:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3f100 x1853163893987584/t8589937327(8589937327) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/664 e 0 to 0 dl 1767316893 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316877.896182:0:81820:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316877.896187:0:81820:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191daa00 x1853163893992960/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316877.896209:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893992960:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316877.896295:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316877.901279:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893992960:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316877.901320:0:81820:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3f100 x1853163893987584/t8589937327(8589937327) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/664 e 0 to 0 dl 1767316893 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316877.901398:0:81820:0:(file.c:424:ll_file_release()) START file . :VOLATILE:0000:7A6034E6:fd=03:[0x200000405:0x8b:0x0](ffff9cfe0edb5b88), flags 554001 00000002:00100000:1.0:1767316877.901589:0:81820:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3dc00 x1853163893987968/t8589937328(8589937328) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 552/608 e 0 to 0 dl 1767316893 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316877.901600:0:81820:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316877.901605:0:81820:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3fb80 x1853163893993216/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316877.901644:0:81820:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893993216:192.168.202.121@tcp:35:lfs.0 00000100:00100000:1.0:1767316877.901776:0:81820:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316877.907715:0:81820:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81820:1853163893993216:192.168.202.121@tcp:35:lfs.0 00000002:00100000:1.0:1767316877.907756:0:81820:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3dc00 x1853163893987968/t8589937328(8589937328) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 552/608 e 0 to 0 dl 1767316893 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316877.918662:0:81821:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316877.918694:0:81821:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316877.918762:0:81821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81821 initiator: MDT0 00010000:00010000:1.0:1767316877.918772:0:81821:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81821 initiator: MDT0 00010000:00010000:1.0:1767316877.918782:0:81821:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81821 initiator: MDT0 00000100:00100000:1.0:1767316877.918890:0:81821:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81821:1853163893993344:192.168.202.121@tcp:101:dd.0 00000100:00100000:1.0:1767316877.919169:0:81821:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316877.926973:0:81821:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81821:1853163893993344:192.168.202.121@tcp:101:dd.0 00010000:00010000:1.0:1767316877.927058:0:81821:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.927073:0:81821:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.927385:0:81821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.927419:0:81821:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.927432:0:81821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.927439:0:81821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.927446:0:81821:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316877.927529:0:81821:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3dc00 x1853163893993344/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316893 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316877.927545:0:81821:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.927559:0:81821:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316877.927565:0:81821:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316877.927592:0:81821:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316877.927599:0:81821:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56952 00000080:00010000:1.0:1767316877.927603:0:81821:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316877.927606:0:81821:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56952 from it ffffa99f40ddbbf8 00010000:00010000:1.0:1767316877.927609:0:81821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.927617:0:81821:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316877.927654:0:81821:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316877.927682:0:81821:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316877.927700:0:81821:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316877.927709:0:81821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.927719:0:81821:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316877.927726:0:81821:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316877.927730:0:81821:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316877.927733:0:81821:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56952 00000080:00010000:1.0:1767316877.927737:0:81821:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56952 from it ffffa99f40ddbb38 00010000:00010000:1.0:1767316877.927740:0:81821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.927747:0:81821:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316877.927755:0:81821:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316877.927760:0:81821:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), file ffff9cfe1128a600, open_flags c241, mode 81b6 opened 0 00000080:00200000:1.0:1767316877.927769:0:81821:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open|creat 00000002:00010000:1.0:1767316877.927789:0:81821:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f211.sanity-flr,[0x200000405:0x8c:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0141102 00010000:00010000:1.0:1767316877.927802:0:81821:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.927848:0:81821:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.927860:0:81821:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316877.927863:0:81821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56952 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655abfc3 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.927902:0:81821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81821 initiator: MDT0 00010000:00010000:1.0:1767316877.927908:0:81821:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81821 initiator: MDT0 00000020:00100000:1.0:1767316877.927919:0:81821:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316877.927925:0:81821:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3dc00 x1853163893993600/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2160/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316877.927934:0:81821:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81821 initiator: MDT0 00000100:00100000:1.0:1767316877.927955:0:81821:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81821:1853163893993600:192.168.202.121@tcp:101:dd.0 00000100:00100000:1.0:1767316877.928595:0:81821:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316877.937930:0:81821:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81821:1853163893993600:192.168.202.121@tcp:101:dd.0 00010000:00010000:1.0:1767316877.937957:0:81821:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfdf expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.937984:0:81821:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfdf expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.937993:0:81821:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfdf expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.938017:0:81821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abfdf expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.938042:0:81821:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfdf expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.938067:0:81821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abfdf expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.938075:0:81821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abfdf expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.938125:0:81821:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abfdf expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316877.938137:0:81821:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=2b, status=0 req@ffff9cfe18f3dc00 x1853163893993600/t8589937340(8589937340) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2160/848 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316877.938150:0:81821:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3dc00 x1853163893993600/t8589937340(8589937340) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2160/848 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316877.938163:0:81821:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfdf expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316877.938177:0:81821:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abfdf expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.938200:0:81821:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767316877.938207:0:81821:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316877.938287:0:81821:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8a:0x0], updating i_size 40960 00000080:00200000:1.0:1767316877.938291:0:81821:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8a:0x0](ffff9cfe0edb21c8): rc = 0 00000080:00200000:1.0:1767316877.938306:0:81821:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 1 -> 1 00000080:00010000:1.0:1767316877.938319:0:81821:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad56959 00000080:00010000:1.0:1767316877.938330:0:81821:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00200008:1.0:1767316877.938348:0:81821:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 141101 00000002:00100000:1.0:1767316877.938374:0:81821:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3dc00 x1853163893993600/t8589937340(8589937340) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 768/848 e 0 to 0 dl 1767316893 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767316877.938407:0:81821:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56959 from it ffff9cfe0f27f1e0 00010000:00010000:1.0:1767316877.938413:0:81821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655abfdf expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.938422:0:81821:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abfdf expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316877.938444:0:81821:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), inode mode 81a4 mask 42 00000002:00010000:1.0:1767316877.938780:0:81821:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x8a:0x0], intent: getxattr flags 0 00010000:00010000:1.0:1767316877.938834:0:81821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 81821 initiator: MDT0 00010000:00010000:1.0:1767316877.938842:0:81821:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81821 initiator: MDT0 00010000:00010000:1.0:1767316877.938851:0:81821:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81821 initiator: MDT0 00000100:00100000:1.0:1767316877.938873:0:81821:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81821:1853163893993728:192.168.202.121@tcp:101:dd.0 00000100:00100000:1.0:1767316877.938968:0:81821:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316877.944709:0:81821:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81821:1853163893993728:192.168.202.121@tcp:101:dd.0 00010000:00010000:1.0:1767316877.944744:0:81821:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abff4 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.944781:0:81821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abff4 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.944792:0:81821:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abff4 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316877.944821:0:81821:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=80 disposition=0, status=0 req@ffff9cfe18f3c000 x1853163893993728/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 568/1336 e 0 to 0 dl 1767316893 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316877.944831:0:81821:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abff4 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.944844:0:81821:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767316877.944850:0:81821:0:(namei.c:955:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x8a:0x0] suppgids 0 -1: rc 0 00000080:00010000:1.0:1767316877.944877:0:81821:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad56960 00000080:00010000:1.0:1767316877.944884:0:81821:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56960 from it ffffa99f40ddba48 00010000:00010000:1.0:1767316877.944888:0:81821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655abff4 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316877.944896:0:81821:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655abff4 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316877.944932:0:81821:0:(llite_lib.c:2314:ll_setattr_raw()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) current size 40960, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1767316877.000000000, mtime 1767316877.000000000, ctime 1767316877.000000000 00010000:00010000:1.0:1767316877.944962:0:81821:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655abfdf expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.944979:0:81821:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.945027:0:81821:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655abfdf expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.945034:0:81821:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316877.945037:0:81821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56959 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655abfdf expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767316877.945068:0:81821:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316877.945076:0:81821:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c000 x1853163893993984/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316877.945297:0:81821:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81821:1853163893993984:192.168.202.121@tcp:36:dd.0 00000100:00100000:1.0:1767316877.945381:0:81821:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316877.951215:0:81821:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81821:1853163893993984:192.168.202.121@tcp:36:dd.0 00000080:00200000:1.0:1767316877.951257:0:81821:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1767316877.951264:0:81821:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316877.951275:0:81821:0:(lov_io.c:385:lov_io_mirror_init()) [0x200000405:0x8a:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:1.0:1767316877.951281:0:81821:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 1 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316877.951285:0:81821:0:(vvp_io.c:356:vvp_io_fini()) [0x200000405:0x8a:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:1.0:1767316877.951294:0:81821:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000002:00010000:1.0:1767316877.951306:0:81821:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: layout flags 02 00010000:00010000:1.0:1767316877.951328:0:81821:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316877.951372:0:81821:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:1.0:1767316877.951409:0:81821:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.951434:0:81821:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316877.951437:0:81821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5694b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655abfae expref: -99 pid: 81820 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.951464:0:81821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81821 initiator: MDT0 00010000:00010000:1.0:1767316877.951471:0:81821:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81821 initiator: MDT0 00000020:00100000:1.0:1767316877.951481:0:81821:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316877.951489:0:81821:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3d880 x1853163893994240/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/1976 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316877.951498:0:81821:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81821 initiator: MDT0 00000100:00100000:1.0:1767316877.951518:0:81821:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81821:1853163893994240:192.168.202.121@tcp:101:dd.0 00000100:00100000:1.0:1767316877.951603:0:81821:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316877.960859:0:81821:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937343 gen 1 00000100:00100000:1.0:1767316877.960899:0:81821:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe18f3dc00 x1853163893993600/t8589937340(8589937340) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 768/848 e 0 to 0 dl 1767316893 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767316877.960917:0:81821:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81821:1853163893994240:192.168.202.121@tcp:101:dd.0 00010000:00010000:1.0:1767316877.960938:0:81821:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.960949:0:81821:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 4/0,1 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.960980:0:81821:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.960990:0:81821:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.961003:0:81821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.961011:0:81821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.961017:0:81821:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767316877.961027:0:81821:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe18f3d880 x1853163893994240/t8589937343(8589937343) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/584 e 0 to 0 dl 1767316893 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316877.961058:0:81821:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767316877.961070:0:81821:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.961114:0:81821:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767316877.961121:0:81821:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316877.961134:0:81821:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad56967 00000080:00010000:1.0:1767316877.961142:0:81821:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56967 from it ffffa99f40ddb930 00010000:00010000:1.0:1767316877.961152:0:81821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.961160:0:81821:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316877.961177:0:81821:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1767316877.961193:0:81821:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 1 restore needed 0 00010000:00010000:1.0:1767316877.961207:0:81821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.961218:0:81821:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767316877.961226:0:81821:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](00000000c42cc73a) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.961259:0:81821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.961266:0:81821:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316877.961306:0:81821:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316877.961315:0:81821:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316877.961318:0:81821:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316877.961323:0:81821:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316877.961361:0:81821:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1767316877.961373:0:81821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.961392:0:81821:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767316877.961400:0:81821:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](00000000c42cc73a) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316877.961417:0:81821:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316877.961421:0:81821:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316877.961424:0:81821:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316877.961426:0:81821:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316877.961451:0:81821:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316877.961516:0:81821:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4294967294 -> 2 00010000:00010000:1.0:1767316877.961521:0:81821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316877.961528:0:81821:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00020000:00200000:1.0:1767316877.961539:0:81821:0:(lov_io.c:308:lov_io_mirror_write_intent()) [0x200000405:0x8a:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:1.0:1767316877.961543:0:81821:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316877.961545:0:81821:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316877.961550:0:81821:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316877.961558:0:81821:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1767316877.961569:0:81821:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1767316877.961574:0:81821:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d790b0, osc lock ffff9cfe09c74e40, flags 0x80000000 00010000:00010000:1.0:1767316877.961584:0:81821:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe04b80000 type 11 mode 2 res 10737419264/160 (0 18446744073709551615) 00010000:00010000:1.0:1767316877.961622:0:81821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.961637:0:81821:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.961646:0:81821:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316877.961669:0:81821:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81821:1853163893994368:192.168.202.121@tcp:101:dd.0 00000100:00100000:1.0:1767316877.961763:0:81821:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:3.0:1767316877.964726:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316877.964834:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939780096 00000100:00100000:2.0:1767316877.964843:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939780096 00000100:00100000:2.0:1767316877.964898:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10171 00000100:00100000:2.0:1767316877.964908:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:48909:x1853163939780096:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316877.964936:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.965006:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316877.965013:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:48909:x1853163939780096:12345-192.168.202.121@tcp:104: Request processed in 107us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316877.965020:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10171 00010000:00010000:1.0:1767316877.965885:0:63840:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316877.965895:0:63840:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.965905:0:63840:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2da00 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:1.0:1767316877.965911:0:63840:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.965958:0:63840:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.965966:0:63840:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316877.965986:0:63840:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.965994:0:63840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56905 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655abedc expref: -99 pid: 81820 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.966022:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316877.966024:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316877.966026:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316877.966044:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893994496:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316877.969972:0:81821:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81821:1853163893994368:192.168.202.121@tcp:101:dd.0 00010000:00010000:1.0:1767316877.970003:0:81821:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000080020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.970015:0:81821:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.970024:0:81821:0:(ldlm_request.c:303:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1767316877.970497:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316877.970576:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939780224 00000100:00100000:2.0:1767316877.970585:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939780224 00000100:00100000:2.0:1767316877.970643:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10172 00000100:00100000:2.0:1767316877.970652:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:50982:x1853163939780224:12345-192.168.202.121@tcp:105: 00010000:00010000:2.0:1767316877.970663:0:42041:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 5/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.970674:0:42041:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 5/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.970683:0:42041:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 5/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000080020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.970693:0:42041:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080080020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.970701:0:42041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080080020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.970711:0:42041:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80080020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.970750:0:42041:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9cfe03c2de00) 00000100:00100000:2.0:1767316877.970812:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:50982:x1853163939780224:12345-192.168.202.121@tcp:105: Request processed in 160us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316877.970821:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10172 00010000:00010000:1.0:1767316877.970945:0:81821:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.970954:0:81821:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.970968:0:81821:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000080020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316877.970978:0:81821:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 40960, setting rss=40960; kms=40960, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020080020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.970995:0:81821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316877.971003:0:81821:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316877.971147:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893994624:192.168.202.121@tcp:10:dd.0 00000100:00100000:1.0:1767316877.974408:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893994496:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316877.974462:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893994624:192.168.202.121@tcp:10:dd.0 00000080:00200000:2.0:1767316877.974827:0:81821:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1767316877.974835:0:81821:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:2.0:1767316877.974839:0:81821:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.974844:0:81821:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d790b0 (ffff9cfe0e4c8d88/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767316877.974854:0:81821:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316877.974868:0:81821:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767316877.974882:0:81821:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316877.974886:0:81821:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d790b0 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316877.974903:0:81821:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767316877.974916:0:81821:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) current size 0, valid attrs a168, mode 0, uid 2, gid 0, new size 0, atime 1767316877.000000000, mtime 1767316877.000000000, ctime 1767316877.000000000, rc 0 00000080:00200008:2.0:1767316877.975021:0:81821:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1767316877.975030:0:81821:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:2.0:1767316877.975040:0:81821:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767316877.975057:0:81821:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767316877.975059:0:81821:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 0 0 00000080:00200000:2.0:1767316877.975063:0:81821:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00020000:00200000:2.0:1767316877.975076:0:81821:0:(lov_io.c:308:lov_io_mirror_write_intent()) [0x200000405:0x8a:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 2 00020000:00200000:2.0:1767316877.975119:0:81821:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316877.975121:0:81821:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767316877.975137:0:81821:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767316877.975144:0:81821:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1767316877.975148:0:81821:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316877.975164:0:81821:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1767316877.975176:0:81821:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:2.0:1767316877.975354:0:81821:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f730, osc lock ffff9cfe2013d0a0, flags 0x0 00000080:00200000:2.0:1767316877.975368:0:81821:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000080:00200000:2.0:1767316877.975381:0:81821:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767316877.975432:0:81821:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316877.975435:0:81821:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000020:00010000:2.0:1767316877.975440:0:81821:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:2.0:1767316877.975443:0:81821:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.975445:0:81821:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f730 (ffff9cfe0e4c8d88/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316877.975448:0:81821:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316877.975450:0:81821:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f730 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316877.975456:0:81821:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767316877.975460:0:81821:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316877.975478:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000008:00100000:2.0:1767316877.975561:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe2910a300 - object 0x280000400:160 offset 0<>4096 00000100:00100000:2.0:1767316877.975604:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767316877.975620:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163893994752:192.168.202.121@tcp:4:dd.0 00000100:00100000:2.0:1767316877.979743:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316877.979839:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939780352 00000100:00100000:3.0:1767316877.979852:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939780352 00000100:00100000:3.0:1767316877.979905:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10173 00000100:00100000:3.0:1767316877.979916:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:41148:x1853163939780352:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316877.979934:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420080020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316877.980014:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316877.980021:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:41148:x1853163939780352:12345-192.168.202.121@tcp:104: Request processed in 108us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316877.980028:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10173 00010000:00010000:0.0:1767316877.980927:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316877.980939:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420080020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316877.980949:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2de00 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316877.980955:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428480020000 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316877.980979:0:63142:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767316877.980993:0:63142:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1767316877.981039:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480020020 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316877.981064:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316877.981118:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480020020 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316877.981127:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad5696e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480020020 nid: local remote: 0x863eb2f6655ac010 expref: -99 pid: 81821 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316877.981159:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.981162:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316877.981163:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316877.981234:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893994880:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316877.985832:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893994880:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316877.989522:0:2504:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9cfe08c17800: committing for last_committed 17179875384 gen 1 00000008:00010000:2.0:1767316877.989580:0:2504:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000020:00200000:2.0:1767316877.989588:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767316877.989595:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767316877.989608:0:2504:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000100:00100000:2.0:1767316877.989649:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163893994752:192.168.202.121@tcp:4:dd.0 00000080:00200000:1.0:1767316877.989977:0:81821:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1767316877.989994:0:81821:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316877.989999:0:81821:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:1.0:1767316877.990013:0:81821:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00200000:1.0:1767316877.990017:0:81821:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316877.990026:0:81821:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200008:1.0:1767316877.990073:0:81821:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 140001 00000002:00100000:1.0:1767316877.990345:0:81821:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3dc00 x1853163893993600/t8589937340(8589937340) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 768/848 e 0 to 0 dl 1767316893 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316877.990357:0:81821:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316877.990362:0:81821:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c000 x1853163893995136/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316877.990396:0:81821:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81821:1853163893995136:192.168.202.121@tcp:35:dd.0 00000100:00100000:1.0:1767316877.990487:0:81821:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316877.993603:0:81821:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job dd:9a586faf-b087-472d-9665-d3bc7d15b908:81821:1853163893995136:192.168.202.121@tcp:35:dd.0 00000002:00100000:1.0:1767316877.993641:0:81821:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3dc00 x1853163893993600/t8589937340(8589937340) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 768/848 e 0 to 0 dl 1767316893 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316878.016698:0:81822:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316878.016732:0:81822:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316878.016885:0:81822:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81822 initiator: MDT0 00010000:00010000:1.0:1767316878.016896:0:81822:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81822 initiator: MDT0 00010000:00010000:1.0:1767316878.016907:0:81822:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81822 initiator: MDT0 00000100:00100000:1.0:1767316878.016937:0:81822:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job ls:9a586faf-b087-472d-9665-d3bc7d15b908:81822:1853163893995264:192.168.202.121@tcp:101:ls.0 00000100:00100000:1.0:1767316878.017533:0:81822:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316878.023490:0:81822:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job ls:9a586faf-b087-472d-9665-d3bc7d15b908:81822:1853163893995264:192.168.202.121@tcp:101:ls.0 00010000:00010000:1.0:1767316878.023517:0:81822:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.023530:0:81822:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.023542:0:81822:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.023575:0:81822:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.023589:0:81822:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.023596:0:81822:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.023604:0:81822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316878.023616:0:81822:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c000 x1853163893995264/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'ls.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316878.023630:0:81822:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.023644:0:81822:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316878.023651:0:81822:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316878.023679:0:81822:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316878.023686:0:81822:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56975 00000080:00010000:1.0:1767316878.023692:0:81822:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316878.023696:0:81822:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56975 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316878.023700:0:81822:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.023707:0:81822:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316878.023748:0:81822:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316878.023769:0:81822:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316878.023774:0:81822:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316878.023978:0:81822:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f211.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316878.024720:0:81822:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81822 initiator: MDT0 00010000:00010000:1.0:1767316878.024730:0:81822:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81822 initiator: MDT0 00010000:00010000:1.0:1767316878.024739:0:81822:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81822 initiator: MDT0 00000100:00100000:1.0:1767316878.024764:0:81822:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job ls:9a586faf-b087-472d-9665-d3bc7d15b908:81822:1853163893995392:192.168.202.121@tcp:101:ls.0 00000100:00100000:2.0:1767316878.026611:0:81822:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:3.0:1767316878.029173:0:81822:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job ls:9a586faf-b087-472d-9665-d3bc7d15b908:81822:1853163893995392:192.168.202.121@tcp:101:ls.0 00010000:00010000:3.0:1767316878.029205:0:81822:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316878.029221:0:81822:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316878.029230:0:81822:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316878.029241:0:81822:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316878.029250:0:81822:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316878.029261:0:81822:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316878.029269:0:81822:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316878.029276:0:81822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316878.029285:0:81822:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c000 x1853163893995392/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/824 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'ls.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316878.029296:0:81822:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316878.029322:0:81822:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316878.029332:0:81822:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:3.0:1767316878.029338:0:81822:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767316878.029379:0:81822:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8a:0x0](ffff9cfe0edb21c8): rc = 0 00000080:00200000:3.0:1767316878.029391:0:81822:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 2 -> 2 00000080:00010000:3.0:1767316878.029395:0:81822:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad5697c 00000080:00010000:3.0:1767316878.029405:0:81822:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:3.0:1767316878.029408:0:81822:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5697c from it ffffa99f40d87b20 00010000:00010000:3.0:1767316878.029411:0:81822:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316878.029419:0:81822:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00000080:00200008:3.0:1767316878.029457:0:81822:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 606, flags 0, foreign 0 00000080:00200000:3.0:1767316878.029463:0:81822:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:3.0:1767316878.029482:0:81822:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316878.029489:0:81822:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316878.029499:0:81822:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316878.029505:0:81822:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316878.029509:0:81822:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:3.0:1767316878.029517:0:81822:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad5697c 00000080:00010000:3.0:1767316878.029521:0:81822:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5697c from it ffffa99f40d87cb8 00010000:00010000:3.0:1767316878.029524:0:81822:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316878.029531:0:81822:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316878.029547:0:81822:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1767316878.029558:0:81822:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767316878.029561:0:81822:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767316878.029565:0:81822:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:3.0:1767316878.029581:0:81822:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767316878.029584:0:81822:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aae30, osc lock ffff9cfe2004ebe0, flags 0x400000400001002 00010000:00010000:3.0:1767316878.029625:0:81822:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316878.029633:0:81822:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316878.029642:0:81822:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe18fd6d80 x1853163893995520/t0(0) o101->lustre-OST0001-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:3.0:1767316878.029668:0:81822:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1767316878.029678:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767316878.029694:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893995520:192.168.202.121@tcp:101:ls.0 00010000:00010000:3.0:1767316878.031972:0:2505:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316878.032013:0:2505:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316878.032028:0:2505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316878.032039:0:2505:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767316878.032062:0:2505:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316878.032074:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1767316878.032107:0:2505:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316878.032116:0:2505:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316878.032122:0:2505:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316878.032138:0:2505:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1767316878.032167:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893995520:192.168.202.121@tcp:101:ls.0 00000080:00200000:2.0:1767316878.032421:0:81822:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:2.0:1767316878.032428:0:81822:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16b58 (ffff9cfe0e4c8c68/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.032431:0:81822:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16b58 (ffff9cfe0e4c8c68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.032436:0:81822:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aae30 (ffff9cfe0e4c81b8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.032440:0:81822:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16b58 (ffff9cfe0e4c8c68/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.032443:0:81822:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aae30 (ffff9cfe0e4c8c68/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316878.032456:0:81822:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316878.032506:0:81822:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316878.032526:0:81822:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316878.032540:0:81822:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316878.032551:0:81822:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316878.032559:0:81822:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316878.032566:0:81822:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316878.032569:0:81822:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56975 00000080:00010000:2.0:1767316878.032574:0:81822:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56975 from it ffffa99f40d87bf8 00010000:00010000:2.0:1767316878.032577:0:81822:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316878.032584:0:81822:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316878.032593:0:81822:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316878.032609:0:81822:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=8 00000080:00200000:2.0:1767316878.032636:0:81822:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316878.032644:0:81822:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316878.032651:0:81822:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316878.032659:0:81822:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316878.032665:0:81822:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316878.032669:0:81822:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316878.032671:0:81822:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56975 00000080:00010000:2.0:1767316878.032675:0:81822:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56975 from it ffffa99f40d87bf8 00010000:00010000:2.0:1767316878.032679:0:81822:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316878.032686:0:81822:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316878.032694:0:81822:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316878.032698:0:81822:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=9 00000080:00200000:2.0:1767316878.061462:0:81823:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316878.061493:0:81823:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316878.061511:0:81823:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316878.061527:0:81823:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316878.061535:0:81823:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316878.061548:0:81823:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316878.061551:0:81823:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56975 00000080:00010000:2.0:1767316878.061559:0:81823:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56975 from it ffffa99f41da3bf8 00010000:00010000:2.0:1767316878.061563:0:81823:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316878.061571:0:81823:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316878.061586:0:81823:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316878.061593:0:81823:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=265 00000080:00200000:2.0:1767316878.061599:0:81823:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), inode mode 81a4 mask 44 00000080:00200008:2.0:1767316878.061605:0:81823:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 100000 00000002:00010000:2.0:1767316878.061622:0:81823:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 04240100001 00010000:00010000:2.0:1767316878.061678:0:81823:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81823 initiator: MDT0 00010000:00010000:2.0:1767316878.061684:0:81823:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81823 initiator: MDT0 00000020:00100000:2.0:1767316878.061696:0:81823:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767316878.061707:0:81823:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe2910a300 x1853163893995776/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767316878.061717:0:81823:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81823 initiator: MDT0 00000100:00100000:2.0:1767316878.061740:0:81823:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job md5sum:9a586faf-b087-472d-9665-d3bc7d15b908:81823:1853163893995776:192.168.202.121@tcp:101:md5sum.0 00000100:00100000:2.0:1767316878.062280:0:81823:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe111bc240 going to sleep for 11 seconds 00000100:00100000:0.0:1767316878.068066:0:81823:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job md5sum:9a586faf-b087-472d-9665-d3bc7d15b908:81823:1853163893995776:192.168.202.121@tcp:101:md5sum.0 00010000:00010000:0.0:1767316878.068326:0:81823:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac056 expref: -99 pid: 81823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.068338:0:81823:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac056 expref: -99 pid: 81823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.068349:0:81823:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac056 expref: -99 pid: 81823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.068361:0:81823:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac056 expref: -99 pid: 81823 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316878.068376:0:81823:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe2910a300 x1853163893995776/t8589937345(8589937345) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316878.068440:0:81823:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe2910a300 x1853163893995776/t8589937345(8589937345) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316878.068467:0:81823:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac056 expref: -99 pid: 81823 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316878.068481:0:81823:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac056 expref: -99 pid: 81823 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.068493:0:81823:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767316878.068500:0:81823:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316878.068555:0:81823:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 2 -> 2 00000080:00010000:0.0:1767316878.068561:0:81823:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad5698a 00000080:00010000:0.0:1767316878.068568:0:81823:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5698a from it ffffa99f41da3bf0 00010000:00010000:0.0:1767316878.068572:0:81823:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac056 expref: -99 pid: 81823 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.068581:0:81823:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac056 expref: -99 pid: 81823 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316878.068610:0:81823:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe2910a300 x1853163893995776/t8589937345(8589937345) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316878.068750:0:81823:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316878.068759:0:81823:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:0.0:1767316878.068938:0:81823:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316878.068949:0:81823:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.068959:0:81823:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.068978:0:81823:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316878.068985:0:81823:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:0.0:1767316878.068988:0:81823:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad5697c 00000080:00010000:0.0:1767316878.068992:0:81823:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5697c from it ffffa99f41da3cd8 00010000:00010000:0.0:1767316878.068995:0:81823:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.069001:0:81823:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.069017:0:81823:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 1 restore needed 0 00020000:00200000:0.0:1767316878.069028:0:81823:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316878.069031:0:81823:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316878.069035:0:81823:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767316878.069066:0:81823:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316878.069070:0:81823:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9eb0, osc lock ffff9cfe201daab0, flags 0x400000400001002 00010000:00010000:0.0:1767316878.069522:0:81823:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.069664:0:81823:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316878.069679:0:81823:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316878.069683:0:81823:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.069691:0:81823:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316878.069703:0:81823:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316878.069714:0:81823:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767316878.069718:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08cfd6d0 (ffff9cfe04a6ec68/0) at cl_lock_release():245 00000020:00010000:1.0:1767316878.069721:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cfd6d0 (ffff9cfe04a6ec68/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316878.069732:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9eb0 (ffff9cfe0e4362d8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316878.069736:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cfd6d0 (ffff9cfe04a6ec68/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316878.069739:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9eb0 (ffff9cfe04a6ec68/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316878.069749:0:81823:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316878.069952:0:81823:0:(file.c:2474:do_file_read_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 0, count: 32768 00000080:00200000:1.0:1767316878.069959:0:81823:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00020000:00200000:1.0:1767316878.069966:0:81823:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316878.069968:0:81823:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:1.0:1767316878.069973:0:81823:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316878.069978:0:81823:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1767316878.069982:0:81823:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316878.069985:0:81823:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316878.069987:0:81823:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767316878.069998:0:81823:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316878.070001:0:81823:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79030, osc lock ffff9cfe09c74850, flags 0x400000400001002 00010000:00010000:1.0:1767316878.070011:0:81823:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.070020:0:81823:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316878.070028:0:81823:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316878.070032:0:81823:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.070039:0:81823:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316878.070071:0:81823:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316878.070077:0:81823:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767316878.070330:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b2480 (ffff9cfe0e4362d8/0) at cl_lock_release():245 00000020:00010000:1.0:1767316878.070332:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b2480 (ffff9cfe0e4362d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316878.070336:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79030 (ffff9cfe0e4c8098/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316878.070339:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b2480 (ffff9cfe0e4362d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316878.070342:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79030 (ffff9cfe0e4362d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316878.070349:0:81823:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316878.070354:0:81823:0:(file.c:2367:file_read_confine_iter()) f211.sanity-flr: read [0, 32768] over eof, kms 4096, file_size 4096. 00000080:00200000:1.0:1767316878.070379:0:81823:0:(rw.c:2016:ll_readpage()) fast read pgno: 0 00000080:00200000:1.0:1767316878.070456:0:81823:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:1.0:1767316878.070463:0:81823:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:1.0:1767316878.070470:0:81823:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 1, [0x200000405:0x8a:0x0] hash] 00000020:00200000:1.0:1767316878.070472:0:81823:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 0 0 00000080:00200000:1.0:1767316878.070475:0:81823:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00020000:00200000:1.0:1767316878.070483:0:81823:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316878.070485:0:81823:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00020000:00200000:1.0:1767316878.070492:0:81823:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:1.0:1767316878.070496:0:81823:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316878.070509:0:81823:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:1.0:1767316878.070518:0:81823:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767316878.070522:0:81823:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79030, osc lock ffff9cfe09c74850, flags 0x400000000000000 00010000:00010000:1.0:1767316878.070531:0:81823:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.070542:0:81823:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.070562:0:81823:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.070569:0:81823:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.070576:0:81823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316878.070585:0:81823:0:(vvp_io.c:827:vvp_io_read_start()) f211.sanity-flr: read [0, 4096) 00000080:00200000:1.0:1767316878.070597:0:81823:0:(vvp_io.c:886:vvp_io_read_start()) count:4096 iocb pos:0 00000008:00010000:1.0:1767316878.070643:0:81823:0:(osc_cache.c:2941:osc_queue_sync_pages()) ### no dlm lock: extent: ffff9cfe04db6cc0 00000008:00010000:1.0:1767316878.070685:0:75366:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe04db6cc0 00010000:00010000:1.0:1767316878.070707:0:75366:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000008:00100000:1.0:1767316878.070746:0:75366:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe18f3dc00 - object 0x280000400:160 offset 0<>4096 00000100:00100000:0.0:1767316878.070838:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893995904:192.168.202.121@tcp:3:md5sum.0 00000008:00010000:1.0:1767316878.074975:0:2502:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe04db6cc0 00000020:00200000:1.0:1767316878.074991:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:1.0:1767316878.075065:0:2502:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe04db6cc0 00000100:00100000:1.0:1767316878.075110:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893995904:192.168.202.121@tcp:3:md5sum.0 00000020:00010000:2.0:1767316878.075335:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe0e4f5218 (ffff9cfe04a6ec68/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.075347:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0e4f5218 (ffff9cfe04a6ec68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.075352:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79030 (ffff9cfe0e4362d8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767316878.075362:0:81823:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.075376:0:81823:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767316878.075458:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0e4f5218 (ffff9cfe04a6ec68/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.075463:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79030 (ffff9cfe04a6ec68/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316878.075471:0:81823:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000080:00200000:2.0:1767316878.075483:0:81823:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316878.075487:0:81823:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 1 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767316878.075492:0:81823:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 4096 00000080:00200008:2.0:1767316878.075512:0:81823:0:(file.c:2474:do_file_read_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 4096, count: 24576 00000080:00200000:2.0:1767316878.075519:0:81823:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00020000:00200000:2.0:1767316878.075529:0:81823:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316878.075532:0:81823:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767316878.075543:0:81823:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316878.075548:0:81823:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 restore needed 0 00020000:00200000:2.0:1767316878.075551:0:81823:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316878.075553:0:81823:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767316878.075556:0:81823:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:2.0:1767316878.075570:0:81823:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316878.075572:0:81823:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f3b0, osc lock ffff9cfe2013d0a0, flags 0x400000400001002 00010000:00010000:2.0:1767316878.075591:0:81823:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.075617:0:81823:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.075630:0:81823:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316878.075633:0:81823:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.075641:0:81823:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.075651:0:81823:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316878.075659:0:81823:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:2.0:1767316878.075662:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b2480 (ffff9cfe0e4362d8/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.075665:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b2480 (ffff9cfe0e4362d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.075668:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f3b0 (ffff9cfe0e4c8c68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.075671:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b2480 (ffff9cfe0e4362d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.075673:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f3b0 (ffff9cfe0e4362d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316878.075683:0:81823:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316878.075688:0:81823:0:(file.c:2367:file_read_confine_iter()) f211.sanity-flr: read [4096, 28672] over eof, kms 4096, file_size 4096. 00000080:00200000:2.0:1767316878.075718:0:81823:0:(rw.c:2016:ll_readpage()) fast read pgno: 1 00000080:00200000:2.0:1767316878.075724:0:81823:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: read ppos: 4096, bytes: 24576 00000080:00200000:2.0:1767316878.075728:0:81823:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767316878.075736:0:81823:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767316878.075738:0:81823:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [4096, 28672) 0 0 00000080:00200000:2.0:1767316878.075741:0:81823:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00020000:00200000:2.0:1767316878.075749:0:81823:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316878.075758:0:81823:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00020000:00200000:2.0:1767316878.075766:0:81823:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 4096 chunk: [4096, 28672) 28672, 24576 00020000:00200000:2.0:1767316878.075769:0:81823:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316878.075937:0:81823:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [1, 6] 00000008:00010000:2.0:1767316878.075947:0:81823:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1767316878.075950:0:81823:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f3b0, osc lock ffff9cfe2013d0a0, flags 0x400000000000000 00010000:00010000:2.0:1767316878.075959:0:81823:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.075968:0:81823:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (4096 28671) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.075977:0:81823:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.075984:0:81823:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.075991:0:81823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767316878.075999:0:81823:0:(vvp_io.c:827:vvp_io_read_start()) f211.sanity-flr: read [4096, 28672) 00000001:00010000:2.0:1767316878.076008:0:81823:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:2.0:1767316878.076013:0:81823:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316878.076015:0:81823:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fdb0, osc lock ffff9cfe2013da20, flags 0x400000400001002 00010000:00010000:2.0:1767316878.076022:0:81823:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 4/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.076030:0:81823:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 4/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.076055:0:81823:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316878.076058:0:81823:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 7/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.076065:0:81823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 6/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.076071:0:81823:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316878.076232:0:81823:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:2.0:1767316878.076237:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08cfd6d0 (ffff9cfe04a6ec68/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.076240:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cfd6d0 (ffff9cfe04a6ec68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.076244:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fdb0 (ffff9cfe0e4362d8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.076247:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cfd6d0 (ffff9cfe04a6ec68/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.076249:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fdb0 (ffff9cfe04a6ec68/1) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.076258:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe0e4f5218 (ffff9cfe04a6ec68/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.076260:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0e4f5218 (ffff9cfe04a6ec68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.076262:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f3b0 (ffff9cfe0e4362d8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767316878.076267:0:81823:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.076275:0:81823:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767316878.076285:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0e4f5218 (ffff9cfe04a6ec68/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.076287:0:81823:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f3b0 (ffff9cfe04a6ec68/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316878.076293:0:81823:0:(vvp_io.c:518:vvp_io_advance()) advancing 0 bytes 00000080:00200000:2.0:1767316878.076306:0:81823:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316878.076310:0:81823:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 1 io complete with rc: 0, result: 0, restart: 0 00000080:00200000:2.0:1767316878.076312:0:81823:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 0 00000080:00200008:2.0:1767316878.076337:0:81823:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_CUR 00000080:00200008:2.0:1767316878.076345:0:81823:0:(file.c:5216:ll_file_seek()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_CUR, rc = 4096 00000080:00200008:2.0:1767316878.076362:0:81823:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 100000 00010000:00010000:2.0:1767316878.076386:0:81823:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac056 expref: -99 pid: 81823 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316878.091634:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316878.091671:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316878.091689:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316878.091705:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316878.091713:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316878.091721:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316878.091725:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56975 00000080:00010000:2.0:1767316878.091733:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56975 from it ffffa99f41d53bf8 00010000:00010000:2.0:1767316878.091737:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316878.091745:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316878.091761:0:81824:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316878.091770:0:81824:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=265 00000080:00200000:2.0:1767316878.091933:0:81824:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), inode mode 81a4 mask 44 00000080:00200008:2.0:1767316878.091940:0:81824:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 154400 00000080:00200000:2.0:1767316878.092015:0:81824:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), inode mode 81a4 mask 4 00000080:00200000:2.0:1767316878.092022:0:81824:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), xattr lov 00000080:00200008:2.0:1767316878.092069:0:81824:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316878.092075:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:2.0:1767316878.092335:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316878.092346:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316878.092356:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316878.092362:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316878.092367:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:2.0:1767316878.092370:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad5697c 00000080:00010000:2.0:1767316878.092374:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5697c from it ffffa99f41d53cd8 00010000:00010000:2.0:1767316878.092377:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316878.092384:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316878.092405:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 restore needed 0 00020000:00200000:2.0:1767316878.092418:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316878.092422:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767316878.092425:0:81824:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:2.0:1767316878.092446:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316878.092450:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f3b0, osc lock ffff9cfe2013d0a0, flags 0x400000400001002 00010000:00010000:2.0:1767316878.092473:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.092484:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.092496:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316878.092499:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.092506:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.092516:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316878.092532:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:2.0:1767316878.092536:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08cfd6d0 (ffff9cfe04a6ec68/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.092540:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cfd6d0 (ffff9cfe04a6ec68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.092543:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f3b0 (ffff9cfe0e4362d8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.092546:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cfd6d0 (ffff9cfe04a6ec68/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.092549:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f3b0 (ffff9cfe04a6ec68/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316878.092561:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767316878.092593:0:81824:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 154000 00010000:00010000:2.0:1767316878.092606:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac056 expref: -99 pid: 81823 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316878.092952:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316878.092964:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316878.092972:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316878.092985:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316878.092991:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316878.092996:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316878.092999:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56975 00000080:00010000:2.0:1767316878.093003:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56975 from it ffffa99f41d53b58 00010000:00010000:2.0:1767316878.093006:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316878.093013:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316878.093022:0:81824:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316878.093028:0:81824:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=9 00000080:00200008:2.0:1767316878.093034:0:81824:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316878.093039:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:2.0:1767316878.093058:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316878.093065:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316878.093072:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316878.093100:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316878.093105:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:2.0:1767316878.093107:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad5697c 00000080:00010000:2.0:1767316878.093117:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5697c from it ffffa99f41d53cb8 00010000:00010000:2.0:1767316878.093121:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316878.093217:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316878.093232:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 restore needed 0 00020000:00200000:2.0:1767316878.093238:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316878.093240:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767316878.093243:0:81824:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:2.0:1767316878.093252:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316878.093254:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f3b0, osc lock ffff9cfe2013d0a0, flags 0x400000400001002 00010000:00010000:2.0:1767316878.093264:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.093273:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.093281:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316878.093284:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.093291:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.093300:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316878.093305:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:2.0:1767316878.093307:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08cfd6d0 (ffff9cfe04a6ec68/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.093315:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cfd6d0 (ffff9cfe04a6ec68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.093319:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f3b0 (ffff9cfe0e4362d8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.093322:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cfd6d0 (ffff9cfe04a6ec68/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.093324:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f3b0 (ffff9cfe04a6ec68/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316878.093332:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316878.093356:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316878.093364:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316878.093370:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316878.093378:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316878.093384:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316878.093388:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316878.093390:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56975 00000080:00010000:2.0:1767316878.093393:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56975 from it ffffa99f41d53bf8 00010000:00010000:2.0:1767316878.093396:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316878.093403:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316878.093411:0:81824:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316878.093415:0:81824:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=265 00000080:00200000:2.0:1767316878.093419:0:81824:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), inode mode 81a4 mask 46 00000080:00200008:2.0:1767316878.093425:0:81824:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 154402 00000002:00010000:2.0:1767316878.093438:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114403 00010000:00010000:2.0:1767316878.093500:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81824 initiator: MDT0 00010000:00010000:2.0:1767316878.093508:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000020:00100000:2.0:1767316878.093520:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767316878.093532:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29108000 x1853163893996160/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767316878.093542:0:81824:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000100:00100000:2.0:1767316878.093562:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893996160:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316878.093826:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe111bc900 going to sleep for 11 seconds 00000100:00100000:3.0:1767316878.097416:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316878.097556:0:42041:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767316878.097578:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939780480 00000100:00100000:2.0:1767316878.097589:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939780480 00000100:00100000:2.0:1767316878.097650:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10174 00000100:00100000:2.0:1767316878.097661:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29094050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939780480:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316878.097679:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316878.097751:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316878.097759:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29094050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939780480:12345-192.168.202.121@tcp:104: Request processed in 100us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316878.097766:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10174 00010000:00010000:0.0:1767316878.099632:0:63296:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316878.099647:0:63296:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.099659:0:63296:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316878.099664:0:63296:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.099690:0:63296:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.099700:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.099725:0:63296:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac056 expref: -99 pid: 81823 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.099734:0:63296:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.099918:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.099925:0:63296:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767316878.100001:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893996288:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767316878.100234:0:63296:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.100242:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5697c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac041 expref: -99 pid: 81822 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.100260:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.100262:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.100263:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316878.103833:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893996288:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316878.104906:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893996160:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316878.104929:0:81824:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.104965:0:81824:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.104972:0:81824:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.104983:0:81824:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.104993:0:81824:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.105005:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.105013:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.105020:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316878.105031:0:81824:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe29108000 x1853163893996160/t8589937346(8589937346) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316878.105044:0:81824:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29108000 x1853163893996160/t8589937346(8589937346) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316878.105070:0:81824:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.105118:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 8 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767316878.105126:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316878.105197:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad56991 00000080:00010000:0.0:1767316878.105205:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56991 from it ffffa99f41d53bf0 00010000:00010000:0.0:1767316878.105208:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.105217:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316878.105245:0:81824:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29108000 x1853163893996160/t8589937346(8589937346) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316878.105392:0:81824:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1767316878.105401:0:81824:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), xattr lov 00000080:00200008:0.0:1767316878.105429:0:81824:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316878.105437:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:0.0:1767316878.105453:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316878.105461:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 30 res 8589935621/138 (0 0) 00010000:00010000:0.0:1767316878.105503:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.105511:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.105521:0:81824:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000100:00100000:0.0:1767316878.105541:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893996416:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316878.105643:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316878.109486:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316878.109585:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939780608 00000100:00100000:3.0:1767316878.109596:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939780608 00000100:00100000:3.0:1767316878.109656:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10175 00000100:00100000:3.0:1767316878.109666:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939780608:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316878.109685:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316878.109787:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316878.109793:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939780608:12345-192.168.202.121@tcp:104: Request processed in 130us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316878.109807:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10175 00010000:00010000:0.0:1767316878.110975:0:49629:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316878.110987:0:49629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.110998:0:49629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05095800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316878.111003:0:49629:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.111011:0:49629:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.111019:0:49629:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.111056:0:49629:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac056 expref: -99 pid: 81823 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.111123:0:49629:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.111139:0:49629:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316878.111161:0:49629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 1/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.111169:0:49629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56991 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac06b expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.111197:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.111199:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.111218:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316878.111238:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893996544:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316878.114525:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893996544:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316878.115388:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893996416:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316878.115411:0:81824:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac080 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.115423:0:81824:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac080 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.115434:0:81824:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac080 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.115444:0:81824:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac080 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.115456:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac080 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.115463:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac080 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.115470:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac080 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316878.115480:0:81824:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d9f80 x1853163893996416/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/824 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316878.115491:0:81824:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac080 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316878.115518:0:81824:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac080 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.115531:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767316878.115538:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316878.115596:0:81824:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 2 -> 2 00000080:00010000:0.0:1767316878.115601:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad56998 00000080:00010000:0.0:1767316878.115607:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:0.0:1767316878.115610:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56998 from it ffffa99f41d53cd8 00010000:00010000:0.0:1767316878.115613:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac080 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.115621:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac080 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.115651:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767316878.115661:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316878.115664:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316878.115668:0:81824:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767316878.115685:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316878.115689:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9f30, osc lock ffff9cfe201db0a0, flags 0x400000400001002 00010000:00010000:0.0:1767316878.115704:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.115715:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316878.115739:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316878.115743:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.115750:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316878.115761:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316878.115771:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:0.0:1767316878.115785:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_release():245 00000020:00010000:0.0:1767316878.115789:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316878.115792:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9f30 (ffff9cfe0e436758/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316878.115796:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316878.115799:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9f30 (ffff9cfe0e436f38/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316878.115816:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:0.0:1767316878.115907:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=c00c66f3 arg=a502e0 00000002:00010000:0.0:1767316878.115931:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: open flags 05004040000002 00010000:00010000:0.0:1767316878.115943:0:81824:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac056 expref: -99 pid: 81823 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.115959:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316878.115999:0:81824:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe2910a300 x1853163893995776/t8589937345(8589937345) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316878.116009:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316878.116021:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9f80 x1853163893996800/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316878.116041:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893996800:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316878.116159:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316878.126421:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893996800:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316878.126462:0:81824:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe2910a300 x1853163893995776/t8589937345(8589937345) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767316878.126505:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac080 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.126553:0:81824:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac056 expref: -99 pid: 81823 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.126561:0:81824:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316878.126564:0:81824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad5698a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac056 expref: -99 pid: 81823 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.126592:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5699f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.126599:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5699f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000020:00100000:0.0:1767316878.126610:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316878.126616:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9f80 x1853163893997056/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316878.126625:0:81824:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5699f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x81000000000000 pid: 81824 initiator: MDT0 00000100:00100000:0.0:1767316878.126667:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893997056:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316878.126844:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316878.133016:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893997056:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316878.133042:0:81824:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5699f lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac08e expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.133064:0:81824:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5699f lrc: 4/1,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac08e expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.133076:0:81824:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5699f lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac08e expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.133122:0:81824:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5699f lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac08e expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.133134:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5699f lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac08e expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.133141:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5699f lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac08e expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.133149:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5699f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac08e expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316878.133162:0:81824:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff9cfe191d9f80 x1853163893997056/t8589937348(8589937348) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316878.133175:0:81824:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d9f80 x1853163893997056/t8589937348(8589937348) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316878.133220:0:81824:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5699f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac08e expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.133242:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 2 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767316878.133249:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1767316878.133270:0:81824:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d9f80 x1853163893997056/t8589937348(8589937348) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767316878.133279:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad5699f 00000080:00010000:0.0:1767316878.133285:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5699f from it ffffa99f41d53cc0 00010000:00010000:0.0:1767316878.133288:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5699f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac08e expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.133296:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5699f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac08e expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316878.133348:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00020000:00200000:0.0:1767316878.133360:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316878.133363:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316878.133370:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:0.0:1767316878.133435:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316878.133452:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893997184:192.168.202.121@tcp:1:lfs.0 00000100:00100000:3.0:1767316878.137655:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316878.137908:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939780736 00000100:00100000:2.0:1767316878.137921:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939780736 00000100:00100000:2.0:1767316878.137989:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10176 00000100:00100000:2.0:1767316878.138000:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:48909:x1853163939780736:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316878.138017:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.138130:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316878.138137:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:48909:x1853163939780736:12345-192.168.202.121@tcp:104: Request processed in 139us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316878.138144:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10176 00010000:00010000:0.0:1767316878.138541:0:63143:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316878.138549:0:63143:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.138558:0:63143:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe27712200 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316878.138573:0:63143:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316878.138591:0:63143:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767316878.138645:0:63143:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1767316878.138689:0:63143:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.138696:0:63143:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316878.138731:0:63143:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.138739:0:63143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56983 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac048 expref: -99 pid: 81822 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.138758:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.138760:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.138761:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316878.138840:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893997312:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316878.141730:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893997312:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316878.141811:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893997184:192.168.202.121@tcp:1:lfs.0 00010000:00010000:0.0:1767316878.141974:0:81824:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.142000:0:81824:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:0.0:1767316878.142017:0:81824:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac080 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.142026:0:81824:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:0.0:1767316878.142075:0:81824:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.142128:0:81824:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac080 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.142134:0:81824:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316878.142138:0:81824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56967 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac009 expref: -99 pid: 81821 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.142154:0:81824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56998 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac080 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767316878.142170:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316878.142179:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191da680 x1853163893997568/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316878.142442:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893997568:192.168.202.121@tcp:36:lfs.0 00000100:00100000:0.0:1767316878.142526:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316878.150364:0:81824:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937349 gen 1 00000100:00100000:0.0:1767316878.150386:0:81824:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe29108000 x1853163893996160/t8589937346(8589937346) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767316878.150398:0:81824:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe191d9f80 x1853163893997056/t8589937348(8589937348) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767316878.150409:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893997568:192.168.202.121@tcp:36:lfs.0 00010000:00010000:0.0:1767316878.150455:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 31 res 8589935621/138 (0 0) 00000080:00010000:0.0:1767316878.150466:0:81824:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000002:00010000:0.0:1767316878.150477:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: layout flags 0 00010000:00010000:0.0:1767316878.150522:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.150543:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.150554:0:81824:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000100:00100000:0.0:1767316878.150575:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893997696:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316878.150662:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316878.158478:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893997696:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316878.158515:0:81824:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.158531:0:81824:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316878.158546:0:81824:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe191da680 x1853163893997696/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/584 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316878.158557:0:81824:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767316878.158575:0:81824:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.158593:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767316878.158603:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316878.158626:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad569a6 00000080:00010000:0.0:1767316878.158635:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569a6 from it ffffa99f41d53c70 00010000:00010000:0.0:1767316878.158639:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.158671:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.158707:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.158723:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316878.158732:0:81824:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](00000000c42cc73a) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.158875:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.158887:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.158906:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316878.158917:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316878.158922:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316878.158931:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316878.158966:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1767316878.159017:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.159027:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316878.159059:0:81824:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](00000000c42cc73a) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.159550:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316878.159556:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316878.159559:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316878.159563:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316878.159573:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316878.159679:0:81824:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1767316878.159686:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.159695:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200080:0.0:1767316878.159721:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=66f4 arg=a502e0 00000080:00200008:0.0:1767316878.159735:0:81824:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316878.159743:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:0.0:1767316878.159758:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316878.159766:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 30 res 8589935621/138 (0 0) 00010000:00010000:0.0:1767316878.159819:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.159827:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.159836:0:81824:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000100:00100000:0.0:1767316878.159872:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893997824:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316878.159968:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316878.164885:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893997824:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316878.164912:0:81824:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.164926:0:81824:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.164938:0:81824:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.164948:0:81824:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.164959:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.164965:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.164972:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316878.164983:0:81824:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191da680 x1853163893997824/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/824 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316878.164995:0:81824:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316878.165019:0:81824:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.165033:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767316878.165040:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316878.165154:0:81824:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 3 -> 3 00000080:00010000:0.0:1767316878.165159:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad569ad 00000080:00010000:0.0:1767316878.165164:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:0.0:1767316878.165167:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569ad from it ffffa99f41d53cd8 00010000:00010000:0.0:1767316878.165170:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.165178:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.165213:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 2 restore needed 0 00020000:00200000:0.0:1767316878.165302:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316878.165306:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316878.165310:0:81824:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767316878.165328:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316878.165331:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9f30, osc lock ffff9cfe201db0a0, flags 0x400000400001002 00010000:00010000:0.0:1767316878.165380:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.165389:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.165399:0:81824:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe191da680 x1853163893997952/t0(0) o101->lustre-OST0001-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1767316878.165445:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1767316878.165478:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893997952:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316878.169754:0:2503:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.170560:0:2503:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.170589:0:2503:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.170603:0:2503:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316878.170620:0:2503:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316878.170632:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767316878.170728:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.170737:0:2503:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.170743:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.170773:0:2503:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316878.170817:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893997952:192.168.202.121@tcp:101:lfs.0 00000080:00200000:2.0:1767316878.171475:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:2.0:1767316878.171483:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.171486:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.171491:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9f30 (ffff9cfe0e436758/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.171495:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.171504:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9f30 (ffff9cfe0e436f38/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316878.171519:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:2.0:1767316878.228919:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=400866b1 arg=1 00000080:00200008:2.0:1767316878.228938:0:81824:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316878.228946:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:2.0:1767316878.228968:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316878.228985:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316878.229470:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316878.229482:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316878.229500:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:2.0:1767316878.229505:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad569ad 00000080:00010000:2.0:1767316878.229513:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569ad from it ffffa99f41d53cd8 00010000:00010000:2.0:1767316878.229517:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316878.229526:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316878.229555:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:2.0:1767316878.229567:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316878.229570:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767316878.229575:0:81824:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:2.0:1767316878.229595:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316878.229598:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f3b0, osc lock ffff9cfe2013d0a0, flags 0x400000400001002 00010000:00010000:2.0:1767316878.229618:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.229629:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.229641:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316878.229645:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.229652:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.229663:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316878.229683:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:2.0:1767316878.229689:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.229692:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.229696:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f3b0 (ffff9cfe0e436758/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.229700:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.229702:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f3b0 (ffff9cfe0e436f38/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316878.229716:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767316878.229737:0:81824:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:2.0:1767316878.229742:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:2.0:1767316878.229746:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316878.229749:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767316878.229753:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316878.229772:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000080:00200000:2.0:1767316878.229959:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316878.229966:0:81824:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1767316878.229969:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767316878.229975:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316878.229979:0:81824:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1767316878.229986:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1767316878.229988:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f3b0, osc lock ffff9cfe2013d0a0, flags 0x0 00010000:00010000:2.0:1767316878.230114:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.230126:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.230135:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.230154:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.230161:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767316878.230173:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000100:00100000:3.0:1767316878.230373:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893998080:192.168.202.121@tcp:23:lfs.0 00000100:00100000:2.0:1767316878.234794:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893998080:192.168.202.121@tcp:23:lfs.0 00000020:00010000:0.0:1767316878.234931:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe27576d58 (ffff9cfe0e436f38/0) at cl_lock_release():245 00000020:00010000:0.0:1767316878.234936:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe27576d58 (ffff9cfe0e436f38/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316878.234942:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f3b0 (ffff9cfe0e436758/1) at cl_lock_cancel():142 00010000:00010000:0.0:1767316878.234957:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.234971:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00010000:0.0:1767316878.234986:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe27576d58 (ffff9cfe0e436f38/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316878.234989:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f3b0 (ffff9cfe0e436f38/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316878.235006:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767316878.235017:0:81824:0:(file.c:5216:ll_file_seek()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:0.0:1767316878.235030:0:81824:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:0.0:1767316878.235039:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:0.0:1767316878.235059:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316878.235062:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316878.235068:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316878.235938:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000080:00200000:0.0:1767316878.235950:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316878.235975:0:81824:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 1 00000080:00200000:0.0:1767316878.235978:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316878.235986:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316878.235992:0:81824:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:0.0:1767316878.236012:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:0.0:1767316878.236016:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9330, osc lock ffff9cfe201db8f0, flags 0x0 00010000:00010000:0.0:1767316878.236035:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.236057:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.236069:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.236078:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.236108:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316878.236119:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000100:00100000:0.0:1767316878.236185:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316878.236203:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893998208:192.168.202.121@tcp:23:lfs.0 00000100:00100000:0.0:1767316878.239576:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893998208:192.168.202.121@tcp:23:lfs.0 00000020:00010000:2.0:1767316878.239777:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe27576d58 (ffff9cfe0e436f38/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.239782:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe27576d58 (ffff9cfe0e436f38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.239788:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9330 (ffff9cfe0e436758/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767316878.239808:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.239821:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767316878.239837:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe27576d58 (ffff9cfe0e436f38/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.239840:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9330 (ffff9cfe0e436f38/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316878.239857:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767316878.239867:0:81824:0:(file.c:5216:ll_file_seek()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_HOLE, rc = 4096 00000080:00200080:2.0:1767316878.239882:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=400866b1 arg=0 00000080:00200080:2.0:1767316878.239891:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=400866b1 arg=1 00000080:00200008:2.0:1767316878.239897:0:81824:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316878.239921:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:2.0:1767316878.239941:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316878.239957:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316878.239970:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316878.239978:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316878.239986:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:2.0:1767316878.239991:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad569ad 00000080:00010000:2.0:1767316878.239996:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569ad from it ffffa99f41d53cd8 00010000:00010000:2.0:1767316878.240013:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316878.240021:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316878.240040:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:2.0:1767316878.240058:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316878.240061:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767316878.240065:0:81824:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:2.0:1767316878.240114:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316878.240118:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fdb0, osc lock ffff9cfe2013da20, flags 0x400000400001002 00010000:00010000:2.0:1767316878.240132:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.240142:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.240166:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316878.240170:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.240178:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.240187:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316878.240198:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:2.0:1767316878.240202:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.240204:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.240207:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fdb0 (ffff9cfe0e436758/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.240210:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.240212:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fdb0 (ffff9cfe0e436f38/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316878.240228:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767316878.240250:0:81824:0:(file.c:2474:do_file_read_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1767316878.240255:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:2.0:1767316878.240259:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316878.240262:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767316878.240270:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316878.240278:0:81824:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:2.0:1767316878.240286:0:81824:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 1 00000020:00200000:2.0:1767316878.240293:0:81824:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767316878.240295:0:81824:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 2048 0 00000080:00200000:2.0:1767316878.240298:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00000080:00200000:2.0:1767316878.240305:0:81824:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767316878.240317:0:81824:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1767316878.240321:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316878.240333:0:81824:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767316878.240341:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767316878.240343:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fdb0, osc lock ffff9cfe2013da20, flags 0x40000 00000080:00200000:2.0:1767316878.240348:0:81824:0:(vvp_io.c:827:vvp_io_read_start()) f211.sanity-flr: read [0, 4096) 00000080:00200000:2.0:1767316878.240359:0:81824:0:(vvp_io.c:886:vvp_io_read_start()) count:4096 iocb pos:0 00000080:00200000:2.0:1767316878.240366:0:81824:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767316878.240414:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316878.240417:0:81824:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000020:00010000:2.0:1767316878.240422:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe27576d58 (ffff9cfe0e436f38/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.240424:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe27576d58 (ffff9cfe0e436f38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.240427:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fdb0 (ffff9cfe0e436758/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.240429:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe27576d58 (ffff9cfe0e436f38/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.240432:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fdb0 (ffff9cfe0e436f38/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316878.240436:0:81824:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767316878.240440:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316878.240458:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000008:00100000:2.0:1767316878.240500:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe2910b100 - object 0x280000400:160 offset 0<>4096 00000100:00100000:2.0:1767316878.240543:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767316878.240560:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893998336:192.168.202.121@tcp:3:lfs.0 00000008:00010000:2.0:1767316878.246956:0:2505:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000020:00200000:2.0:1767316878.246966:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767316878.246972:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767316878.246999:0:2505:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000100:00100000:2.0:1767316878.247026:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163893998336:192.168.202.121@tcp:3:lfs.0 00000080:00200000:0.0:1767316878.247176:0:81824:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767316878.247190:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316878.247212:0:81824:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 1 io complete with rc: 0, result: 4096, restart: 0 00000020:00200000:0.0:1767316878.247215:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316878.247225:0:81824:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 4096 00000080:00200080:0.0:1767316878.247245:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=400866b1 arg=0 00000080:00200080:0.0:1767316878.247255:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=400866b1 arg=2 00000080:00200008:0.0:1767316878.247262:0:81824:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316878.247269:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:0.0:1767316878.247289:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316878.247307:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.247322:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.247329:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316878.247338:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:0.0:1767316878.247341:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad569ad 00000080:00010000:0.0:1767316878.247348:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569ad from it ffffa99f41d53cd8 00010000:00010000:0.0:1767316878.247353:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.247361:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.247384:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:0.0:1767316878.247394:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316878.247397:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316878.247401:0:81824:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767316878.247437:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316878.247441:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9530, osc lock ffff9cfe201db300, flags 0x400000400001002 00010000:00010000:0.0:1767316878.247466:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.247476:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316878.247486:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316878.247489:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.247497:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316878.247507:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316878.247517:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:0.0:1767316878.247521:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_release():245 00000020:00010000:0.0:1767316878.247525:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316878.247529:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9530 (ffff9cfe0e436758/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316878.247533:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316878.247537:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9530 (ffff9cfe0e436f38/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316878.247544:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767316878.247566:0:81824:0:(file.c:2648:do_file_write_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 0, count: 4096 00000080:00200000:0.0:1767316878.247573:0:81824:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:0.0:1767316878.247581:0:81824:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 2 00000020:00200000:0.0:1767316878.247587:0:81824:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:0.0:1767316878.247588:0:81824:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:0.0:1767316878.247595:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00000080:00200000:0.0:1767316878.247602:0:81824:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1767316878.247608:0:81824:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:0.0:1767316878.247610:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:0.0:1767316878.247621:0:81824:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1767316878.247626:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:0.0:1767316878.247629:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9530, osc lock ffff9cfe201db300, flags 0x40000 00000080:00200000:0.0:1767316878.247634:0:81824:0:(vvp_io.c:1312:vvp_io_write_start()) f211.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000080:00200000:0.0:1767316878.247658:0:81824:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:0.0:1767316878.247704:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1767316878.247705:0:81824:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:0.0:1767316878.247712:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:0.0:1767316878.247715:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe27576d58 (ffff9cfe0e436f38/0) at cl_lock_release():245 00000020:00010000:0.0:1767316878.247716:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe27576d58 (ffff9cfe0e436f38/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316878.247718:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9530 (ffff9cfe0e436758/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316878.247720:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe27576d58 (ffff9cfe0e436f38/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316878.247721:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9530 (ffff9cfe0e436f38/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316878.247725:0:81824:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:0.0:1767316878.247728:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1767316878.247741:0:78255:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe21417540 00000008:00100000:0.0:1767316878.247793:0:78255:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe191da680 - object 0x2c0000400:159 offset 0<>4096 00000100:00100000:1.0:1767316878.248161:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893998464:192.168.202.121@tcp:4:lfs.0 00000100:00100000:1.0:1767316878.256665:0:2503:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff9cfe08c17800: committing for last_committed 25769805119 gen 1 00000008:00010000:1.0:1767316878.256716:0:2503:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe21417540 00000020:00200000:1.0:1767316878.256724:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:1.0:1767316878.256733:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:1.0:1767316878.256750:0:2503:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe21417540 00000100:00100000:1.0:1767316878.256775:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893998464:192.168.202.121@tcp:4:lfs.0 00000080:00200000:0.0:1767316878.256836:0:81824:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767316878.256852:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316878.256857:0:81824:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:0.0:1767316878.256867:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00200000:0.0:1767316878.256870:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316878.256878:0:81824:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:0.0:1767316878.256894:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=400866b1 arg=0 00000080:00200080:0.0:1767316878.256901:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=400866b1 arg=1 00000080:00200008:0.0:1767316878.256908:0:81824:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316878.256916:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:0.0:1767316878.256947:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316878.256964:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.256975:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.256980:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316878.256986:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:0.0:1767316878.256989:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad569ad 00000080:00010000:0.0:1767316878.256995:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569ad from it ffffa99f41d53cd8 00010000:00010000:0.0:1767316878.257269:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.257280:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.257304:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:0.0:1767316878.257314:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316878.257317:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316878.257320:0:81824:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:0.0:1767316878.257338:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316878.257341:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9530, osc lock ffff9cfe201db300, flags 0x400000400001002 00010000:00010000:0.0:1767316878.257356:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.257365:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316878.257388:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316878.257391:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.257399:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316878.257409:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316878.257415:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:0.0:1767316878.257547:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_release():245 00000020:00010000:0.0:1767316878.257552:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316878.257556:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9530 (ffff9cfe0e436758/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316878.257560:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316878.257563:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9530 (ffff9cfe0e436f38/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316878.257573:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316878.257679:0:81824:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 4096, type: SEEK_DATA 00000080:00200000:1.0:1767316878.257687:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00020000:00200000:1.0:1767316878.257693:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316878.257695:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316878.257699:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316878.257717:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000080:00200000:1.0:1767316878.257726:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316878.257731:0:81824:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 1 00000080:00200000:1.0:1767316878.257733:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316878.257737:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316878.257741:0:81824:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [1, 18446744073709551615] 00000008:00010000:1.0:1767316878.257749:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:1.0:1767316878.257752:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79630, osc lock ffff9cfe09c74f70, flags 0x0 00010000:00010000:1.0:1767316878.257761:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.257771:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (4096 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.257788:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.257871:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.257880:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316878.257892:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767316878.257897:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:1.0:1767316878.257899:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316878.257902:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79630 (ffff9cfe0e4c8d88/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767316878.257906:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.257912:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767316878.257922:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316878.257924:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79630 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316878.257933:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316878.257941:0:81824:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: (null) 00000080:00200000:1.0:1767316878.257945:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:1.0:1767316878.257949:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316878.257957:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316878.257960:0:81824:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767316878.257971:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316878.257974:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79630, osc lock ffff9cfe09c74f70, flags 0x400000400001002 00010000:00010000:1.0:1767316878.257982:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.257990:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316878.258061:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316878.258067:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.258074:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316878.258105:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316878.258110:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767316878.258113:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:1.0:1767316878.258115:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316878.258118:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79630 (ffff9cfe0e4c8d88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316878.258121:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316878.258123:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79630 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316878.258275:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316878.258284:0:81824:0:(file.c:5216:ll_file_seek()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: (null), rc = 4096 00000080:00200080:1.0:1767316878.258291:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=400866b1 arg=0 00000080:00200080:1.0:1767316878.273774:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=400866b1 arg=2 00000080:00200008:1.0:1767316878.273893:0:81824:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316878.273902:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:1.0:1767316878.273920:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316878.273937:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316878.273952:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316878.273959:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316878.273966:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:1.0:1767316878.273969:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad569ad 00000080:00010000:1.0:1767316878.273976:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569ad from it ffffa99f41d53cd8 00010000:00010000:1.0:1767316878.273980:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316878.273990:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316878.274247:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:1.0:1767316878.274258:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316878.274262:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316878.274265:0:81824:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767316878.274283:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316878.274287:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79630, osc lock ffff9cfe09c74f70, flags 0x400000400001002 00010000:00010000:1.0:1767316878.274304:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.274313:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316878.274333:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316878.274337:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.274345:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316878.274355:0:81824:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316878.274365:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767316878.274370:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:1.0:1767316878.274373:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316878.274377:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79630 (ffff9cfe0e4c8d88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316878.274381:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316878.274384:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79630 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316878.274395:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316878.274550:0:81824:0:(llite_lib.c:2314:ll_setattr_raw()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) current size 4096, valid attrs 2068, mode 0, uid -1941070030, gid -1, new size 4096, atime 1767316878.000000000, mtime 1767316878.000000000, ctime 1767316878.000000000 00010000:00010000:1.0:1767316878.274577:0:81824:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316878.274593:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316878.274636:0:81824:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316878.274643:0:81824:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316878.274651:0:81824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad569ad lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac0b8 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767316878.274677:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316878.274691:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3dc00 x1853163893998720/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316878.274716:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893998720:192.168.202.121@tcp:36:lfs.0 00000100:00100000:1.0:1767316878.275007:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255480 going to sleep for 11 seconds 00000100:00100000:1.0:1767316878.280558:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893998720:192.168.202.121@tcp:36:lfs.0 00000080:00200000:1.0:1767316878.280601:0:81824:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 2 00000080:00200000:1.0:1767316878.280608:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:1.0:1767316878.280629:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:1.0:1767316878.280647:0:81824:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1767316878.280664:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767316878.280669:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79630, osc lock ffff9cfe09c74f70, flags 0x0 00010000:00010000:1.0:1767316878.280725:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.280737:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.280749:0:81824:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316878.280768:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893998848:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316878.280964:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255480 going to sleep for 11 seconds 00000100:00100000:1.0:1767316878.285925:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893998848:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316878.285958:0:81824:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.285991:0:81824:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.286015:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316878.286027:0:81824:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 40960, setting rss=40960; kms=40960, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/0,2 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.286039:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.286056:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316878.286184:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316878.286200:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893998976:192.168.202.121@tcp:10:lfs.0 00000100:00100000:1.0:1767316878.290148:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893998976:192.168.202.121@tcp:10:lfs.0 00000080:00200000:2.0:1767316878.291901:0:81824:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:2.0:1767316878.291911:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.291915:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.291920:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79630 (ffff9cfe0e4c8d88/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767316878.291947:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.291959:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767316878.291974:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.291977:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79630 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316878.291994:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767316878.292623:0:81824:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) current size 4096, valid attrs 2168, mode 0, uid -1941070030, gid -1, new size 4096, atime 1767316878.000000000, mtime 1767316878.000000000, ctime 1767316878.000000000, rc 0 00000080:00200080:2.0:1767316878.292648:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=400866b1 arg=0 00000080:00200008:2.0:1767316878.292678:0:81824:0:(llite_lib.c:2314:ll_setattr_raw()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) current size 4096, valid attrs 101f0, mode a99f, uid 249458904, gid -25346, new size 18446635213717709256, atime 1767316878.000000000, mtime 1767316877.000000000, ctime 1767316878.000000000 00000020:00100000:2.0:1767316878.292741:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767316878.292753:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe2910b100 x1853163893999232/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767316878.292776:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893999232:192.168.202.121@tcp:36:lfs.0 00000100:00100000:2.0:1767316878.293025:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe111bc180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316878.298711:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893999232:192.168.202.121@tcp:36:lfs.0 00000080:00200000:1.0:1767316878.298759:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316878.298773:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316878.298776:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316878.298783:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316878.298807:0:81824:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1767316878.298838:0:81824:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767316878.298844:0:81824:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d791b0, osc lock ffff9cfe09c74390, flags 0x0 00010000:00010000:1.0:1767316878.298861:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe04b80000 type 11 mode 2 res 10737419264/160 (0 18446744073709551615) 00010000:00010000:1.0:1767316878.298906:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.298917:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.298927:0:81824:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316878.298948:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893999360:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316878.299122:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255480 going to sleep for 11 seconds 00000100:00100000:2.0:1767316878.302590:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316878.302688:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939781120 00000100:00100000:3.0:1767316878.302699:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939781120 00000100:00100000:3.0:1767316878.302786:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10177 00000100:00100000:3.0:1767316878.302809:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:48910:x1853163939781120:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316878.302828:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316878.302905:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316878.302914:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:48910:x1853163939781120:12345-192.168.202.121@tcp:104: Request processed in 118us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316878.302934:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10177 00010000:00010000:0.0:1767316878.302992:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316878.303009:0:59093:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.303018:0:59093:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c800 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316878.303023:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316878.303042:0:59093:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767316878.303065:0:59093:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1767316878.303164:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.303172:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316878.303191:0:59093:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.303199:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac0bf expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.303215:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.303217:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.303219:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316878.303227:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316878.303241:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893999488:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316878.309142:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316878.309233:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939781248 00000100:00100000:3.0:1767316878.309243:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939781248 00000100:00100000:3.0:1767316878.309297:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10178 00000100:00100000:3.0:1767316878.309308:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:50982:x1853163939781248:12345-192.168.202.121@tcp:105: 00010000:00010000:3.0:1767316878.309323:0:42040:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316878.309335:0:42040:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316878.309344:0:42040:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316878.309377:0:42040:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000000000 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316878.309393:0:42040:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000000000 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316878.309402:0:42040:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000000000 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316878.309439:0:42040:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9cfe03c2ce00) 00000100:00100000:3.0:1767316878.309497:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:50982:x1853163939781248:12345-192.168.202.121@tcp:105: Request processed in 191us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316878.309520:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10178 00000100:00100000:0.0:1767316878.312245:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163893999488:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316878.313722:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893999360:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316878.313753:0:81824:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.313772:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316878.313784:0:81824:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.313917:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.313952:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316878.314065:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316878.314100:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893999616:192.168.202.121@tcp:2:lfs.0 00000100:00100000:1.0:1767316878.319181:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163893999616:192.168.202.121@tcp:2:lfs.0 00000020:00010000:0.0:1767316878.319266:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284038 (ffff9cfe0e4c8a28/0) at cl_lock_release():245 00000020:00010000:0.0:1767316878.319272:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284038 (ffff9cfe0e4c8a28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316878.319277:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d791b0 (ffff9cfe0e4c85a8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1767316878.319288:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316878.319301:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00010000:0.0:1767316878.319318:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284038 (ffff9cfe0e4c8a28/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316878.319322:0:81824:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d791b0 (ffff9cfe0e4c8a28/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316878.319357:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767316878.319372:0:81824:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) current size 4096, valid attrs 101f0, mode a99f, uid 249458904, gid -25346, new size 18446635213717709256, atime 1767316878.000000000, mtime 1767316877.000000000, ctime 1767316878.000000000, rc 0 00000080:00200080:0.0:1767316878.319395:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=c00c66f3 arg=a502e0 00010000:00010000:0.0:1767316878.319460:0:81824:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5699f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x863eb2f6655ac08e expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.319475:0:81824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5699f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x863eb2f6655ac08e expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316878.319494:0:81824:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191d9f80 x1853163893997056/t8589937348(8589937348) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316878.319506:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316878.319511:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9180 x1853163893999872/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316878.319534:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893999872:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316878.319615:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316878.324342:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316878.324570:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939781376 00000100:00100000:3.0:1767316878.324579:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939781376 00000100:00100000:3.0:1767316878.324633:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10179 00000100:00100000:3.0:1767316878.324642:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15471:x1853163939781376:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316878.324662:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316878.324742:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316878.324750:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15471:x1853163939781376:12345-192.168.202.121@tcp:104: Request processed in 108us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316878.324757:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10179 00010000:00010000:0.0:1767316878.324948:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316878.324954:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.324960:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316878.324964:0:42049:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.324970:0:42049:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.324991:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.325012:0:42049:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:0.0:1767316878.325062:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.325068:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316878.325130:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.325138:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569a6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac0aa expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.325152:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.325154:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.325156:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316878.325163:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316878.325177:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894000000:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316878.336801:0:81824:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937353 gen 1 00000100:00100000:2.0:1767316878.336838:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163893999872:192.168.202.121@tcp:35:lfs.0 00000002:00100000:2.0:1767316878.336872:0:81824:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191d9f80 x1853163893997056/t8589937348(8589937348) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1767316878.336921:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 31 res 8589935621/138 (0 0) 00000080:00010000:2.0:1767316878.336932:0:81824:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000002:00010000:2.0:1767316878.336943:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: layout flags 0 00010000:00010000:2.0:1767316878.336982:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81824 initiator: MDT0 00010000:00010000:2.0:1767316878.336988:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00010000:00010000:2.0:1767316878.336994:0:81824:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000100:00100000:2.0:1767316878.337008:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894000128:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316878.337183:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe111bc480 going to sleep for 11 seconds 00000100:00100000:0.0:1767316878.337327:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894000000:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316878.340715:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894000128:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316878.340745:0:81824:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.340758:0:81824:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316878.340858:0:81824:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe2910b100 x1853163894000128/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/584 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316878.340871:0:81824:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767316878.340883:0:81824:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.340897:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767316878.340903:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316878.340922:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad569c9 00000080:00010000:0.0:1767316878.340930:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569c9 from it ffffa99f41d53bc8 00010000:00010000:0.0:1767316878.340933:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.340941:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.340965:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.340975:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316878.340982:0:81824:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](00000000c42cc73a) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.341021:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.341034:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.341058:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316878.341068:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316878.341071:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316878.341397:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316878.341429:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1767316878.341444:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.341453:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316878.341459:0:81824:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](00000000c42cc73a) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.341476:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 3 restore needed 0 00020000:00200000:0.0:1767316878.341481:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316878.341483:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316878.341486:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316878.341494:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1767316878.341507:0:81824:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1767316877 1767316877 1767316877 by oinfo size 4096 blocks 8 [cma]time 1767316878 1767316877 1767316878 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316878.341531:0:81824:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 40960 blocks 80 [cma]time: 1767316878 1767316878 1767316877 by oinfo size 4096 blocks 8 [cma]time 1767316878 1767316878 1767316877 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 1/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316878.341582:0:81824:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1767316878.341587:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.341595:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316878.341629:0:81824:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 154002 00000002:00100000:0.0:1767316878.341675:0:81824:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe29108000 x1853163893996160/t8589937346(8589937346) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316878.341687:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316878.341692:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191db480 x1853163894000384/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316878.341714:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894000384:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316878.341853:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316878.344660:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894000384:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316878.344702:0:81824:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe29108000 x1853163893996160/t8589937346(8589937346) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316878.344872:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316878.344892:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316878.344908:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.344920:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316878.344943:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316878.344949:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316878.344952:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56975 00000080:00010000:0.0:1767316878.344960:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56975 from it ffffa99f41d53bf8 00010000:00010000:0.0:1767316878.344964:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.344973:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316878.344986:0:81824:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316878.344999:0:81824:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), file ffff9cfe0eb19b00, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1767316878.345006:0:81824:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open 00000002:00010000:0.0:1767316878.345021:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f211.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0154401 00010000:00010000:0.0:1767316878.345286:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.345294:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000020:00100000:0.0:1767316878.345305:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316878.345312:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191db480 x1853163894000640/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2160/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316878.345320:0:81824:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000100:00100000:0.0:1767316878.345342:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894000640:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316878.345568:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316878.350619:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894000640:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316878.350646:0:81824:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.350666:0:81824:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.350673:0:81824:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.350684:0:81824:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.350695:0:81824:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.350707:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.350715:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.350723:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316878.350734:0:81824:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe191db480 x1853163894000640/t8589937355(8589937355) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2160/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316878.350768:0:81824:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191db480 x1853163894000640/t8589937355(8589937355) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2160/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316878.350781:0:81824:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316878.350866:0:81824:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.350880:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767316878.350887:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316878.350935:0:81824:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8a:0x0], updating i_size 4096 00000080:00200000:0.0:1767316878.350939:0:81824:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8a:0x0](ffff9cfe0edb21c8): rc = 0 00000080:00200000:0.0:1767316878.350952:0:81824:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1767316878.350957:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad569d0 00000080:00010000:0.0:1767316878.350967:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00200008:0.0:1767316878.350981:0:81824:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 154400 00000002:00100000:0.0:1767316878.351003:0:81824:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191db480 x1853163894000640/t8589937355(8589937355) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 768/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767316878.351052:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569d0 from it ffff9cfe2751c420 00010000:00010000:0.0:1767316878.351057:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.351064:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.351310:0:81824:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), inode mode 81a4 mask 44 00000080:00200000:0.0:1767316878.351372:0:81824:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1767316878.351384:0:81824:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), xattr lov 00000080:00200008:0.0:1767316878.351410:0:81824:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316878.351416:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:0.0:1767316878.351439:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316878.351449:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.351461:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.351468:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316878.351473:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:0.0:1767316878.351476:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad569d0 00000080:00010000:0.0:1767316878.351479:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569d0 from it ffffa99f41d53cd8 00010000:00010000:0.0:1767316878.351483:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.351490:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316878.351525:0:81824:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 154000 00000002:00100000:0.0:1767316878.351567:0:81824:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191db480 x1853163894000640/t8589937355(8589937355) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 768/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316878.351578:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316878.351583:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191daa00 x1853163894000896/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316878.351607:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894000896:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316878.351758:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316878.354672:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894000896:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316878.354705:0:81824:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191db480 x1853163894000640/t8589937355(8589937355) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 768/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316878.354876:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316878.354896:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316878.354913:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.354926:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316878.354933:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316878.354939:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316878.354943:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56975 00000080:00010000:0.0:1767316878.354949:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56975 from it ffffa99f41d53bf8 00010000:00010000:0.0:1767316878.354953:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.354961:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316878.354975:0:81824:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316878.354981:0:81824:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=265 00000080:00200000:0.0:1767316878.354986:0:81824:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), inode mode 81a4 mask 46 00000080:00200008:0.0:1767316878.354994:0:81824:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 154402 00000002:00010000:0.0:1767316878.355009:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114403 00010000:00010000:0.0:1767316878.355567:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.355576:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000020:00100000:0.0:1767316878.355589:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316878.355596:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191daa00 x1853163894001152/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316878.355607:0:81824:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000100:00100000:0.0:1767316878.355628:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894001152:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316878.355864:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21a80 going to sleep for 11 seconds 00000100:00100000:2.0:1767316878.359858:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316878.359940:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939781760 00000100:00100000:3.0:1767316878.359951:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939781760 00000100:00100000:3.0:1767316878.360014:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10180 00000100:00100000:3.0:1767316878.360024:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15469:x1853163939781760:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316878.360041:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316878.360159:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316878.360167:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15469:x1853163939781760:12345-192.168.202.121@tcp:104: Request processed in 144us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316878.360175:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10180 00010000:00010000:0.0:1767316878.360444:0:42048:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316878.360452:0:42048:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.360460:0:42048:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316878.360465:0:42048:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.360473:0:42048:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.360481:0:42048:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.360507:0:42048:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.360571:0:42048:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.360578:0:42048:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316878.360606:0:42048:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.360613:0:42048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569d0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac113 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.360632:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.360633:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.360635:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316878.360653:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894001280:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316878.364314:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894001280:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316878.365840:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894001152:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316878.365865:0:81824:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac128 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.365882:0:81824:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac128 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.365888:0:81824:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac128 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.365899:0:81824:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac128 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.365926:0:81824:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac128 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.365940:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac128 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.365947:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac128 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.365954:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac128 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316878.365965:0:81824:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe191daa00 x1853163894001152/t8589937357(8589937357) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316878.365978:0:81824:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191daa00 x1853163894001152/t8589937357(8589937357) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316878.365991:0:81824:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac128 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.366001:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 8 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767316878.366007:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316878.366067:0:81824:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8a:0x0], updating i_size 4096 00000080:00010000:0.0:1767316878.366073:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad569d7 00000080:00010000:0.0:1767316878.366098:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569d7 from it ffffa99f41d53bf0 00010000:00010000:0.0:1767316878.366103:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac128 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.366135:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac128 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316878.366167:0:81824:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191daa00 x1853163894001152/t8589937357(8589937357) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:0.0:1767316878.366432:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=800466af arg=7ffc2cc8c06c 00000080:00200080:0.0:1767316878.366447:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=80086601 arg=7ffc2cc8c008 00000100:00100000:0.0:1767316878.366489:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894001408:192.168.202.121@tcp:33:lfs.0 00000100:00100000:0.0:1767316878.366630:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316878.370516:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894001408:192.168.202.121@tcp:33:lfs.0 00000080:00200080:0.0:1767316878.370558:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=c00c66f3 arg=7ffc2cc8bff4 00000002:00010000:0.0:1767316878.370587:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: open flags 01004040000002 00010000:00010000:0.0:1767316878.370608:0:81824:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ac128 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.370665:0:81824:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 1/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac128 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.370672:0:81824:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316878.370675:0:81824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569d7 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x8a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac128 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.370699:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569de lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.370726:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569de lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000020:00100000:0.0:1767316878.370747:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316878.370752:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191db480 x1853163894001664/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316878.370759:0:81824:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569de lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x81000000000000 pid: 81824 initiator: MDT0 00000100:00100000:0.0:1767316878.370774:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894001664:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316878.371019:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316878.377290:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894001664:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316878.377319:0:81824:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569de lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac13d expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.377331:0:81824:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569de lrc: 4/1,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac13d expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.377343:0:81824:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569de lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac13d expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.377354:0:81824:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569de lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac13d expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.377367:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569de lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac13d expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.377375:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569de lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac13d expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.377401:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569de lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac13d expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316878.377413:0:81824:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff9cfe191db480 x1853163894001664/t8589937358(8589937358) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316878.377426:0:81824:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191db480 x1853163894001664/t8589937358(8589937358) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316878.377442:0:81824:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569de lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac13d expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.377456:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 2 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767316878.377472:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1767316878.377493:0:81824:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191db480 x1853163894001664/t8589937358(8589937358) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767316878.377502:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad569de 00000080:00010000:0.0:1767316878.377508:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569de from it ffffa99f41d53cc0 00010000:00010000:0.0:1767316878.377511:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569de lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac13d expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.377517:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569de lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac13d expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000080:00200080:0.0:1767316878.377573:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=c00c66f3 arg=a50430 00010000:00010000:0.0:1767316878.377617:0:81824:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569de lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x863eb2f6655ac13d expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.377644:0:81824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569de lrc: 0/0,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x863eb2f6655ac13d expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316878.377659:0:81824:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191db480 x1853163894001664/t8589937358(8589937358) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316878.377670:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316878.377675:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191dad80 x1853163894001920/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316878.377697:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894001920:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316878.378000:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21a80 going to sleep for 11 seconds 00000100:00100000:3.0:1767316878.382767:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316878.382923:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:1.0:1767316878.382995:0:42038:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939782016 00000100:00100000:1.0:1767316878.383014:0:42038:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939782016 00000100:00100000:1.0:1767316878.383097:0:42038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 471 00000100:00100000:1.0:1767316878.383107:0:42038:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15470:x1853163939782016:12345-192.168.202.121@tcp:104: 00010000:00010000:1.0:1767316878.383137:0:42038:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655abff4 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.383227:0:42038:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1767316878.383234:0:42038:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15470:x1853163939782016:12345-192.168.202.121@tcp:104: Request processed in 129us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316878.383242:0:42038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 471 00010000:00010000:1.0:1767316878.383263:0:63840:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316878.383268:0:63840:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655abff4 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.383277:0:63840:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d600 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316878.383283:0:63840:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655abff4 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.383310:0:63840:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655abff4 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.383319:0:63840:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655abff4 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.383367:0:63840:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655abff4 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.383374:0:63840:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316878.383396:0:63840:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655abff4 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.383403:0:63840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56960 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x20 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655abff4 expref: -99 pid: 81821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.383417:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316878.383419:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316878.383420:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316878.383437:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894002048:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316878.386266:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894002048:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316878.386705:0:42041:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767316878.386724:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939781888 00000100:00100000:2.0:1767316878.386731:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939781888 00000100:00100000:2.0:1767316878.386775:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10181 00000100:00100000:2.0:1767316878.386785:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29097850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15470:x1853163939781888:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316878.386906:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316878.387028:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316878.387035:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29097850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15470:x1853163939781888:12345-192.168.202.121@tcp:104: Request processed in 252us (4280us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316878.387053:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10181 00010000:00010000:0.0:1767316878.387251:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316878.387260:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.387269:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05094600 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316878.387274:0:63142:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.387283:0:63142:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.387290:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.387313:0:63142:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:0.0:1767316878.387353:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.387373:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316878.387402:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.387410:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad569c9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac0f7 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.387432:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.387434:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.387436:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316878.387516:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894002176:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316878.390792:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894002176:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316878.392741:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894001920:192.168.202.121@tcp:35:lfs.0 00000080:00020000:0.0:1767316878.392760:0:81824:0:(file.c:249:ll_close_inode_openhandle()) lustre-clilmv-ffff9cfe08c17800: inode [0x200000405:0x8a:0x0] mdc close failed: rc = -22 00000002:00100000:0.0:1767316878.403556:0:81824:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191db480 x1853163894001664/t8589937358(8589937358) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767316878.403607:0:81824:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000002:00010000:0.0:1767316878.403619:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: layout flags 0 00010000:00010000:0.0:1767316878.403674:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.403684:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.403694:0:81824:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000100:00100000:0.0:1767316878.403715:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894002304:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316878.404284:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21a80 going to sleep for 11 seconds 00010000:00010000:3.0:1767316878.406917:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316878.409466:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894002304:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316878.409511:0:81824:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.409527:0:81824:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316878.409542:0:81824:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe191db480 x1853163894002304/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/584 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316878.409552:0:81824:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767316878.409565:0:81824:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.409578:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767316878.409584:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316878.409601:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad569e5 00000080:00010000:0.0:1767316878.409608:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569e5 from it ffffa99f41d53bc8 00010000:00010000:0.0:1767316878.409612:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.409621:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.409645:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.409655:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316878.409674:0:81824:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](00000000c42cc73a) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.409713:0:81824:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1767316878.409718:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.409725:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.409878:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316878.409895:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316878.409904:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.409911:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316878.409917:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316878.409922:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316878.409926:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56975 00000080:00010000:0.0:1767316878.409929:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56975 from it ffffa99f41d53bf8 00010000:00010000:0.0:1767316878.409932:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.409938:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316878.409959:0:81824:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316878.409975:0:81824:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316878.409982:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316878.409989:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.409996:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316878.410641:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316878.410646:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316878.410650:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56975 00000080:00010000:0.0:1767316878.410655:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56975 from it ffffa99f41d53b38 00010000:00010000:0.0:1767316878.410659:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.410666:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316878.410676:0:81824:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316878.410682:0:81824:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=. :VOLATILE:0000:8449C2A:fd=03, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), file ffff9cfe0eb19b00, open_flags 2f9c2, mode 8180 opened 0 00000080:00200000:0.0:1767316878.410729:0:81824:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=. :VOLATILE:0000:8449C2A:fd=03, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open|creat 00000002:00010000:0.0:1767316878.410753:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: . :VOLATILE:0000:8449C2A:fd=03,[0x200000405:0x8d:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0574703 00010000:00010000:0.0:1767316878.410767:0:81824:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.410840:0:81824:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.410846:0:81824:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316878.410849:0:81824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56975 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac025 expref: -99 pid: 81822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.410884:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.410890:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000020:00100000:0.0:1767316878.410901:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316878.410911:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191db480 x1853163894002560/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 552/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316878.410920:0:81824:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000100:00100000:0.0:1767316878.410941:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894002560:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316878.411217:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316878.416986:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894002560:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316878.417030:0:81824:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.417073:0:81824:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.417136:0:81824:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.417167:0:81824:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.417178:0:81824:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.417202:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.417210:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.417217:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316878.417228:0:81824:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff9cfe191db480 x1853163894002560/t8589937360(8589937360) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 552/608 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316878.417241:0:81824:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191db480 x1853163894002560/t8589937360(8589937360) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 552/608 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316878.417253:0:81824:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.417263:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/141 (0 0) 00000080:00200000:0.0:1767316878.417269:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316878.417283:0:81824:0:(namei.c:1569:ll_create_it()) VFS Op:name=. :VOLATILE:0000:8449C2A:fd=03, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open|creat 00000080:00200000:0.0:1767316878.417310:0:81824:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x8d:0x0](ffff9cfe187dec08) 00000080:00200000:0.0:1767316878.417317:0:81824:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8d:0x0], updating i_size 0 00000080:00200000:0.0:1767316878.417357:0:81824:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8d:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1767316878.417363:0:81824:0:(namei.c:1535:ll_create_node()) setting l_ast_data to inode [0x200000405:0x8d:0x0](ffff9cfe187dec08) 00000080:00010000:0.0:1767316878.417367:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8d:0x0](ffff9cfe187dec08) for lock 0xd9a0da65fad569ec 00000080:00010000:0.0:1767316878.417377:0:81824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8d:0x0](ffff9cfe187dec08) 00000080:00200008:0.0:1767316878.417392:0:81824:0:(file.c:1001:ll_file_open()) START file . :VOLATILE:0000:8449C2A:fd=03:[0x200000405:0x8d:0x0](ffff9cfe187dec08), flags 574702 00000002:00100000:0.0:1767316878.417413:0:81824:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191db480 x1853163894002560/t8589937360(8589937360) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 552/608 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767316878.417443:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569ec from it ffff9cfe2751c420 00010000:00010000:0.0:1767316878.417531:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.417541:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316878.417566:0:81824:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8d:0x0](ffff9cfe187dec08), inode mode 8180 mask 40 00000080:00200080:0.0:1767316878.417590:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=c00c66f3 arg=7ffc2cc8bff4 00000002:00010000:0.0:1767316878.417610:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: open flags 01004040000002 00010000:00010000:0.0:1767316878.417665:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569f3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.417672:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569f3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000020:00100000:0.0:1767316878.417683:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316878.417689:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8a80 x1853163894002816/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316878.417698:0:81824:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569f3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x81000000000000 pid: 81824 initiator: MDT0 00000100:00100000:0.0:1767316878.417727:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894002816:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316878.417899:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316878.422570:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894002816:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316878.422599:0:81824:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569f3 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac175 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.422611:0:81824:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569f3 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac175 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.422625:0:81824:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569f3 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac175 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.422634:0:81824:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569f3 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac175 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.422647:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569f3 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac175 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.422655:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569f3 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac175 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.422662:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569f3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac175 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316878.422672:0:81824:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff9cfe191d8a80 x1853163894002816/t8589937361(8589937361) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316878.422685:0:81824:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d8a80 x1853163894002816/t8589937361(8589937361) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316878.422717:0:81824:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569f3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac175 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.422730:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 2 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767316878.422736:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1767316878.422756:0:81824:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d8a80 x1853163894002816/t8589937361(8589937361) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767316878.422765:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad569f3 00000080:00010000:0.0:1767316878.422771:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569f3 from it ffffa99f41d53cc0 00010000:00010000:0.0:1767316878.422774:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569f3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac175 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.422781:0:81824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569f3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac175 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000080:00200080:0.0:1767316878.422908:0:81824:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) cmd=c00c66f3 arg=a50450 00010000:00010000:0.0:1767316878.422953:0:81824:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569f3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x863eb2f6655ac175 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316878.422965:0:81824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad569f3 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x8a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x863eb2f6655ac175 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316878.422979:0:81824:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191d8a80 x1853163894002816/t8589937361(8589937361) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316878.422989:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316878.422994:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8380 x1853163894003072/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316878.423019:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894003072:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316878.423138:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21a80 going to sleep for 11 seconds 00000100:00100000:2.0:1767316878.427439:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316878.427643:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939782144 00000100:00100000:3.0:1767316878.427655:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939782144 00000100:00100000:3.0:1767316878.427720:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10182 00000100:00100000:3.0:1767316878.427732:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15470:x1853163939782144:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316878.427751:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316878.428598:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316878.428614:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15470:x1853163939782144:12345-192.168.202.121@tcp:104: Request processed in 880us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316878.428624:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10182 00010000:00010000:0.0:1767316878.430107:0:49629:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316878.430341:0:49629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.430357:0:49629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316878.430363:0:49629:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.430372:0:49629:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.430381:0:49629:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.430405:0:49629:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:0.0:1767316878.430457:0:49629:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.430463:0:49629:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767316878.430541:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894003200:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767316878.432823:0:49629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.432838:0:49629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569e5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x8 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac152 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.432864:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.432866:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316878.432884:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316878.435155:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:1.0:1767316878.435332:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894003200:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316878.435450:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939782272 00000100:00100000:3.0:1767316878.435458:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939782272 00000100:00100000:3.0:1767316878.435509:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10183 00000100:00100000:3.0:1767316878.435519:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15470:x1853163939782272:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316878.435534:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316878.435615:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316878.435622:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15470:x1853163939782272:12345-192.168.202.121@tcp:104: Request processed in 106us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316878.435629:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10183 00010000:00010000:1.0:1767316878.435939:0:63143:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316878.435946:0:63143:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.435954:0:63143:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037d200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316878.435959:0:63143:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.435968:0:63143:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.435976:0:63143:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316878.436000:0:63143:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8d:0x0]: losing layout lock 00010000:00010000:1.0:1767316878.436053:0:63143:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.436060:0:63143:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316878.436104:0:63143:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.436112:0:63143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad569ec lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac160 expref: -99 pid: 81824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.436131:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316878.436133:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316878.436134:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316878.436141:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316878.436154:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894003328:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316878.442165:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894003328:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316878.444200:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894003072:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316878.444248:0:81824:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191d8a80 x1853163894002816/t8589937361(8589937361) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767316878.444292:0:81824:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000002:00010000:0.0:1767316878.444305:0:81824:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: layout flags 0 00010000:00010000:0.0:1767316878.444363:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.444373:0:81824:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00010000:00010000:0.0:1767316878.444382:0:81824:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81824 initiator: MDT0 00000100:00100000:0.0:1767316878.444401:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894003456:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316878.444481:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316878.448372:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894003456:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316878.448403:0:81824:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.448417:0:81824:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316878.448431:0:81824:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe191d8380 x1853163894003456/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/480 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316878.448441:0:81824:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767316878.448473:0:81824:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.448486:0:81824:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:0.0:1767316878.448492:0:81824:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8a:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316878.448511:0:81824:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad569fa 00000080:00010000:0.0:1767316878.448519:0:81824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad569fa from it ffffa99f41d53bc8 00010000:00010000:0.0:1767316878.448523:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.448532:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.448555:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.448565:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316878.448574:0:81824:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](00000000c42cc73a) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.448611:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.448619:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.448645:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316878.448655:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316878.448659:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316878.448665:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316878.448693:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1767316878.448705:0:81824:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.448713:0:81824:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316878.448721:0:81824:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8a:0x0](00000000c42cc73a) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316878.448734:0:81824:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316878.448738:0:81824:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8a:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316878.448740:0:81824:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316878.448742:0:81824:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316878.448748:0:81824:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316878.448880:0:81824:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4294967294 -> 5 00010000:00010000:0.0:1767316878.448885:0:81824:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316878.448892:0:81824:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316878.448929:0:81824:0:(file.c:424:ll_file_release()) START file . :VOLATILE:0000:8449C2A:fd=03:[0x200000405:0x8d:0x0](ffff9cfe187dec08), flags 554002 00000002:00100000:0.0:1767316878.448985:0:81824:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191db480 x1853163894002560/t8589937360(8589937360) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 552/608 e 0 to 0 dl 1767316894 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316878.449003:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316878.449009:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8380 x1853163894003712/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316878.449031:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894003712:192.168.202.121@tcp:35:lfs.0 00000100:00100000:2.0:1767316878.450109:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21600 going to sleep for 11 seconds 00000100:00100000:2.0:1767316878.453930:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894003712:192.168.202.121@tcp:35:lfs.0 00000002:00100000:2.0:1767316878.453972:0:81824:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191db480 x1853163894002560/t8589937360(8589937360) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 552/608 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1767316878.454033:0:81824:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 154002 00000002:00100000:2.0:1767316878.454459:0:81824:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191daa00 x1853163894001152/t8589937357(8589937357) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767316878.454471:0:81824:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767316878.454476:0:81824:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29108a80 x1853163894003968/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767316878.454498:0:81824:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894003968:192.168.202.121@tcp:35:lfs.0 00000100:00100000:2.0:1767316878.454581:0:81824:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe111bcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1767316878.457673:0:81824:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:81824:1853163894003968:192.168.202.121@tcp:35:lfs.0 00000002:00100000:2.0:1767316878.457714:0:81824:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191daa00 x1853163894001152/t8589937357(8589937357) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316878.469994:0:81825:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316878.470423:0:81825:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316878.470486:0:81825:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 81825 initiator: MDT0 00010000:00010000:1.0:1767316878.470497:0:81825:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81825 initiator: MDT0 00010000:00010000:1.0:1767316878.470508:0:81825:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 81825 initiator: MDT0 00000100:00100000:1.0:1767316878.470534:0:81825:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f480 pname:cluuid:pid:xid:nid:opc:job ls:9a586faf-b087-472d-9665-d3bc7d15b908:81825:1853163894004096:192.168.202.121@tcp:101:ls.0 00000100:00100000:1.0:1767316878.470821:0:81825:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255480 going to sleep for 11 seconds 00000100:00100000:1.0:1767316878.474541:0:81825:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f480 pname:cluuid:pid:xid:nid:opc:job ls:9a586faf-b087-472d-9665-d3bc7d15b908:81825:1853163894004096:192.168.202.121@tcp:101:ls.0 00010000:00010000:1.0:1767316878.474568:0:81825:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.474581:0:81825:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.474594:0:81825:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.474604:0:81825:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.474615:0:81825:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.474639:0:81825:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.474646:0:81825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316878.474656:0:81825:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3f480 x1853163894004096/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'ls.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316878.474670:0:81825:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.474683:0:81825:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316878.474689:0:81825:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316878.474718:0:81825:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316878.474725:0:81825:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a01 00000080:00010000:1.0:1767316878.474731:0:81825:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316878.474734:0:81825:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a01 from it ffffa99f41c3bb58 00010000:00010000:1.0:1767316878.474737:0:81825:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.474746:0:81825:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316878.474775:0:81825:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316878.474808:0:81825:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316878.474813:0:81825:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316878.474836:0:81825:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f211.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316878.474882:0:81825:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81825 initiator: MDT0 00010000:00010000:1.0:1767316878.474889:0:81825:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81825 initiator: MDT0 00010000:00010000:1.0:1767316878.474898:0:81825:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81825 initiator: MDT0 00000100:00100000:1.0:1767316878.474919:0:81825:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f480 pname:cluuid:pid:xid:nid:opc:job ls:9a586faf-b087-472d-9665-d3bc7d15b908:81825:1853163894004224:192.168.202.121@tcp:101:ls.0 00000100:00100000:1.0:1767316878.475004:0:81825:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255480 going to sleep for 11 seconds 00000100:00100000:1.0:1767316878.478590:0:81825:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f480 pname:cluuid:pid:xid:nid:opc:job ls:9a586faf-b087-472d-9665-d3bc7d15b908:81825:1853163894004224:192.168.202.121@tcp:101:ls.0 00010000:00010000:1.0:1767316878.478620:0:81825:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.478637:0:81825:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.478645:0:81825:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.478656:0:81825:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.478666:0:81825:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.478679:0:81825:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.478687:0:81825:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.478715:0:81825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316878.478727:0:81825:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3f480 x1853163894004224/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/720 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'ls.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316878.478739:0:81825:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316878.478752:0:81825:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316878.478763:0:81825:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767316878.478770:0:81825:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316878.478828:0:81825:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8a:0x0](ffff9cfe0edb21c8): rc = 0 00000080:00200000:1.0:1767316878.478841:0:81825:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 5 -> 5 00000080:00010000:1.0:1767316878.478846:0:81825:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad56a08 00000080:00010000:1.0:1767316878.478855:0:81825:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:1.0:1767316878.478858:0:81825:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a08 from it ffffa99f41c3bb20 00010000:00010000:1.0:1767316878.478861:0:81825:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316878.478869:0:81825:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767316878.478908:0:81825:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 606, flags 0, foreign 0 00000080:00200000:1.0:1767316878.478915:0:81825:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:1.0:1767316878.478935:0:81825:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316878.478954:0:81825:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316878.478963:0:81825:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316878.478970:0:81825:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316878.478974:0:81825:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:1.0:1767316878.478978:0:81825:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad56a08 00000080:00010000:1.0:1767316878.478982:0:81825:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a08 from it ffffa99f41c3bcb8 00010000:00010000:1.0:1767316878.478985:0:81825:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316878.478991:0:81825:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316878.479010:0:81825:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1767316878.479020:0:81825:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767316878.479076:0:81825:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316878.479105:0:81825:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d794b0, osc lock ffff9cfe09c75560, flags 0x400001002 00010000:00010000:1.0:1767316878.479122:0:81825:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.479141:0:81825:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316878.479156:0:81825:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316878.479180:0:81825:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316878.479599:0:81825:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 5/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.479608:0:81825:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316878.479620:0:81825:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316878.479632:0:81825:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767316878.479636:0:81825:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d176c0 (ffff9cfe0e4c8b48/0) at cl_lock_release():245 00000020:00010000:1.0:1767316878.479640:0:81825:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d176c0 (ffff9cfe0e4c8b48/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316878.479643:0:81825:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d794b0 (ffff9cfe0e4c87e8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316878.479647:0:81825:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d176c0 (ffff9cfe0e4c8b48/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316878.479649:0:81825:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d794b0 (ffff9cfe0e4c8b48/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316878.479659:0:81825:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316878.479702:0:81825:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316878.479715:0:81825:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316878.479723:0:81825:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.479731:0:81825:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316878.479737:0:81825:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316878.479741:0:81825:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316878.479743:0:81825:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a01 00000080:00010000:1.0:1767316878.479755:0:81825:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a01 from it ffffa99f41c3bbf8 00010000:00010000:1.0:1767316878.479758:0:81825:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.479765:0:81825:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316878.479773:0:81825:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316878.479779:0:81825:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=8 00000080:00200000:1.0:1767316878.479920:0:81825:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316878.479929:0:81825:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316878.479936:0:81825:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.479943:0:81825:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316878.479948:0:81825:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316878.479952:0:81825:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316878.479954:0:81825:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a01 00000080:00010000:1.0:1767316878.479958:0:81825:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a01 from it ffffa99f41c3bbf8 00010000:00010000:1.0:1767316878.479961:0:81825:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.479967:0:81825:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316878.479975:0:81825:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316878.479978:0:81825:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=9 00000080:00200000:1.0:1767316878.494784:0:81826:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316878.494895:0:81826:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316878.494912:0:81826:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.494929:0:81826:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316878.494936:0:81826:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316878.494944:0:81826:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316878.494948:0:81826:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a01 00000080:00010000:1.0:1767316878.494954:0:81826:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a01 from it ffffa99f41467bf8 00010000:00010000:1.0:1767316878.494958:0:81826:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.494966:0:81826:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316878.494982:0:81826:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316878.494989:0:81826:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=265 00000080:00200000:1.0:1767316878.494994:0:81826:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), inode mode 81a4 mask 44 00000080:00200008:1.0:1767316878.495000:0:81826:0:(file.c:1001:ll_file_open()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 100000 00000002:00010000:1.0:1767316878.495016:0:81826:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 04240100001 00010000:00010000:1.0:1767316878.495406:0:81826:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad56a0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 81826 initiator: MDT0 00010000:00010000:1.0:1767316878.495416:0:81826:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad56a0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81826 initiator: MDT0 00000020:00100000:1.0:1767316878.495429:0:81826:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316878.495450:0:81826:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f480 x1853163894004480/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316878.495460:0:81826:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad56a0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 81826 initiator: MDT0 00000100:00100000:1.0:1767316878.495483:0:81826:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f480 pname:cluuid:pid:xid:nid:opc:job md5sum:9a586faf-b087-472d-9665-d3bc7d15b908:81826:1853163894004480:192.168.202.121@tcp:101:md5sum.0 00000100:00100000:1.0:1767316878.495705:0:81826:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316878.506640:0:81826:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f480 pname:cluuid:pid:xid:nid:opc:job md5sum:9a586faf-b087-472d-9665-d3bc7d15b908:81826:1853163894004480:192.168.202.121@tcp:101:md5sum.0 00010000:00010000:1.0:1767316878.506687:0:81826:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad56a0f lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1d0 expref: -99 pid: 81826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.506700:0:81826:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad56a0f lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1d0 expref: -99 pid: 81826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.506711:0:81826:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad56a0f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1d0 expref: -99 pid: 81826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316878.506722:0:81826:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad56a0f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1d0 expref: -99 pid: 81826 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316878.506737:0:81826:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe18f3f480 x1853163894004480/t8589937368(8589937368) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/744 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316878.506749:0:81826:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f480 x1853163894004480/t8589937368(8589937368) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/744 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316878.506761:0:81826:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad56a0f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1d0 expref: -99 pid: 81826 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316878.506773:0:81826:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad56a0f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1d0 expref: -99 pid: 81826 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316878.507140:0:81826:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/138 (0 0) 00000080:00200000:1.0:1767316878.507149:0:81826:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316878.507203:0:81826:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 5 -> 5 00000080:00010000:1.0:1767316878.507208:0:81826:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad56a0f 00000080:00010000:1.0:1767316878.507214:0:81826:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a0f from it ffffa99f41467bf0 00010000:00010000:1.0:1767316878.507219:0:81826:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad56a0f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac1d0 expref: -99 pid: 81826 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316878.507228:0:81826:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad56a0f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac1d0 expref: -99 pid: 81826 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767316878.507259:0:81826:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f480 x1853163894004480/t8589937368(8589937368) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 656/744 e 0 to 0 dl 1767316894 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316878.507391:0:81826:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316878.507399:0:81826:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:1.0:1767316878.507419:0:81826:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316878.507430:0:81826:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316878.507440:0:81826:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316878.507446:0:81826:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316878.507452:0:81826:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:1.0:1767316878.507456:0:81826:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad56a08 00000080:00010000:1.0:1767316878.507459:0:81826:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a08 from it ffffa99f41467cd8 00010000:00010000:1.0:1767316878.507468:0:81826:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316878.507475:0:81826:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316878.507492:0:81826:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00000001:00010000:1.0:1767316878.507502:0:81826:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767316878.507519:0:81826:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316878.507522:0:81826:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79730, osc lock ffff9cfe09c75560, flags 0x400001002 00010000:00010000:1.0:1767316878.507539:0:81826:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.507548:0:81826:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316878.507560:0:81826:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316878.507563:0:81826:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 5/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.507571:0:81826:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316878.507581:0:81826:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316878.507591:0:81826:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767316878.507595:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d176c0 (ffff9cfe0e4c8b48/0) at cl_lock_release():245 00000020:00010000:1.0:1767316878.507598:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d176c0 (ffff9cfe0e4c8b48/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316878.507601:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79730 (ffff9cfe0e4c87e8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316878.507605:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d176c0 (ffff9cfe0e4c8b48/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316878.507614:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79730 (ffff9cfe0e4c8b48/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316878.507625:0:81826:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316878.507653:0:81826:0:(file.c:2474:do_file_read_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 0, count: 32768 00000080:00200000:1.0:1767316878.507659:0:81826:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:1.0:1767316878.507665:0:81826:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316878.507669:0:81826:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1767316878.507673:0:81826:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767316878.507703:0:81826:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316878.507705:0:81826:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79730, osc lock ffff9cfe09c75560, flags 0x400001002 00010000:00010000:1.0:1767316878.507713:0:81826:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.507722:0:81826:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316878.507730:0:81826:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316878.507733:0:81826:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 5/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.507740:0:81826:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316878.507749:0:81826:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316878.507753:0:81826:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767316878.507755:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d166c8 (ffff9cfe0e4c87e8/0) at cl_lock_release():245 00000020:00010000:1.0:1767316878.507758:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d166c8 (ffff9cfe0e4c87e8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316878.507760:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79730 (ffff9cfe0e4c8518/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316878.507763:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d166c8 (ffff9cfe0e4c87e8/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316878.507771:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79730 (ffff9cfe0e4c87e8/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316878.507778:0:81826:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316878.507783:0:81826:0:(file.c:2367:file_read_confine_iter()) f211.sanity-flr: read [0, 32768] over eof, kms 4096, file_size 4096. 00000080:00200000:1.0:1767316878.507997:0:81826:0:(rw.c:2016:ll_readpage()) fast read pgno: 0 00000080:00200000:1.0:1767316878.508005:0:81826:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:1.0:1767316878.508009:0:81826:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:1.0:1767316878.508016:0:81826:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 1, [0x200000405:0x8a:0x0] hash] 00000020:00200000:1.0:1767316878.508018:0:81826:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 0 0 00000080:00200000:1.0:1767316878.508021:0:81826:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767316878.508033:0:81826:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:1.0:1767316878.508037:0:81826:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316878.508060:0:81826:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:1.0:1767316878.508069:0:81826:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767316878.508072:0:81826:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79730, osc lock ffff9cfe09c75560, flags 0x0 00010000:00010000:1.0:1767316878.508106:0:81826:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.508116:0:81826:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.508136:0:81826:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 6/1,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.508144:0:81826:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 6/1,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316878.508152:0:81826:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 5/1,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316878.508161:0:81826:0:(vvp_io.c:827:vvp_io_read_start()) f211.sanity-flr: read [0, 4096) 00000080:00200000:1.0:1767316878.508179:0:81826:0:(vvp_io.c:886:vvp_io_read_start()) count:4096 iocb pos:0 00000008:00010000:1.0:1767316878.508219:0:81826:0:(osc_cache.c:2941:osc_queue_sync_pages()) ### no dlm lock: extent: ffff9cfe04db6900 00000008:00010000:1.0:1767316878.508265:0:75366:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe04db6900 00010000:00010000:1.0:1767316878.508287:0:75366:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/1,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000008:00100000:1.0:1767316878.508323:0:75366:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe18f3ca80 - object 0x2c0000400:159 offset 0<>4096 00000100:00100000:1.0:1767316878.508369:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894004608:192.168.202.121@tcp:3:md5sum.0 00000008:00010000:1.0:1767316878.511773:0:2503:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe04db6900 00000020:00200000:1.0:1767316878.511803:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:1.0:1767316878.511818:0:2503:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe04db6900 00000100:00100000:1.0:1767316878.511844:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894004608:192.168.202.121@tcp:3:md5sum.0 00000020:00010000:2.0:1767316878.512001:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284998 (ffff9cfe0e4c8b48/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.512005:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284998 (ffff9cfe0e4c8b48/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.512010:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79730 (ffff9cfe0e4c87e8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767316878.512020:0:81826:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/1,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.512032:0:81826:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767316878.512071:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284998 (ffff9cfe0e4c8b48/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.512074:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79730 (ffff9cfe0e4c8b48/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316878.512119:0:81826:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000080:00200000:2.0:1767316878.512139:0:81826:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316878.512144:0:81826:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 1 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1767316878.512148:0:81826:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 4096 00000080:00200008:2.0:1767316878.512164:0:81826:0:(file.c:2474:do_file_read_iter()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], ppos: 4096, count: 24576 00000080:00200000:2.0:1767316878.512170:0:81826:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:2.0:1767316878.512185:0:81826:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316878.512189:0:81826:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00000001:00010000:2.0:1767316878.512193:0:81826:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:2.0:1767316878.512216:0:81826:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316878.512220:0:81826:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fdb0, osc lock ffff9cfe2013da20, flags 0x400001002 00010000:00010000:2.0:1767316878.512237:0:81826:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.512249:0:81826:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.512259:0:81826:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316878.512262:0:81826:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 5/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.512268:0:81826:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.512287:0:81826:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316878.512294:0:81826:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:2.0:1767316878.512298:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d166c8 (ffff9cfe0e4c87e8/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.512300:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d166c8 (ffff9cfe0e4c87e8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.512302:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fdb0 (ffff9cfe0e4c8098/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.512305:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d166c8 (ffff9cfe0e4c87e8/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.512307:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fdb0 (ffff9cfe0e4c87e8/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316878.512314:0:81826:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316878.512318:0:81826:0:(file.c:2367:file_read_confine_iter()) f211.sanity-flr: read [4096, 28672] over eof, kms 4096, file_size 4096. 00000080:00200000:2.0:1767316878.512346:0:81826:0:(rw.c:2016:ll_readpage()) fast read pgno: 1 00000080:00200000:2.0:1767316878.512351:0:81826:0:(file.c:1994:ll_file_io_generic()) f211.sanity-flr: read ppos: 4096, bytes: 24576 00000080:00200000:2.0:1767316878.512355:0:81826:0:(file.c:1759:ll_io_set_mirror()) f211.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1767316878.512362:0:81826:0:(cl_io.c:214:cl_io_rw_init()) header@000000005ed127c8[0x4, 2, [0x200000405:0x8a:0x0] hash] 00000020:00200000:2.0:1767316878.512364:0:81826:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [4096, 28672) 0 0 00000080:00200000:2.0:1767316878.512367:0:81826:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1767316878.512378:0:81826:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 4096 chunk: [4096, 28672) 28672, 24576 00020000:00200000:2.0:1767316878.512382:0:81826:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316878.512394:0:81826:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [1, 6] 00000008:00010000:2.0:1767316878.512402:0:81826:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1767316878.512405:0:81826:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fdb0, osc lock ffff9cfe2013da20, flags 0x0 00010000:00010000:2.0:1767316878.512413:0:81826:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.512423:0:81826:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (4096 28671) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.512431:0:81826:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 6/1,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.512451:0:81826:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 6/1,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.512458:0:81826:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 5/1,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767316878.512466:0:81826:0:(vvp_io.c:827:vvp_io_read_start()) f211.sanity-flr: read [4096, 28672) 00000001:00010000:2.0:1767316878.512476:0:81826:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:2.0:1767316878.512481:0:81826:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316878.512484:0:81826:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322feb0, osc lock ffff9cfe2013ce40, flags 0x400001002 00010000:00010000:2.0:1767316878.512490:0:81826:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/1,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.512499:0:81826:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/1,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.512507:0:81826:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316878.512510:0:81826:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 7/1,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.512516:0:81826:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 6/1,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316878.512522:0:81826:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316878.512525:0:81826:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:2.0:1767316878.512528:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d176c0 (ffff9cfe0e4c8b48/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.512536:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d176c0 (ffff9cfe0e4c8b48/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.512539:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322feb0 (ffff9cfe0e4c87e8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.512542:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d176c0 (ffff9cfe0e4c8b48/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.512544:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322feb0 (ffff9cfe0e4c8b48/1) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.512552:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284998 (ffff9cfe0e4c8b48/0) at cl_lock_release():245 00000020:00010000:2.0:1767316878.512554:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284998 (ffff9cfe0e4c8b48/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316878.512556:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fdb0 (ffff9cfe0e4c87e8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767316878.512560:0:81826:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/1,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316878.512568:0:81826:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767316878.512576:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284998 (ffff9cfe0e4c8b48/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316878.512579:0:81826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fdb0 (ffff9cfe0e4c8b48/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316878.512583:0:81826:0:(vvp_io.c:518:vvp_io_advance()) advancing 0 bytes 00000080:00200000:2.0:1767316878.512588:0:81826:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316878.512591:0:81826:0:(file.c:2142:ll_file_io_generic()) f211.sanity-flr: 1 io complete with rc: 0, result: 0, restart: 0 00000080:00200000:2.0:1767316878.512594:0:81826:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 0 00000080:00200008:2.0:1767316878.512617:0:81826:0:(file.c:5185:ll_file_seek()) START file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_CUR 00000080:00200008:2.0:1767316878.512624:0:81826:0:(file.c:5216:ll_file_seek()) COMPLETED file f211.sanity-flr:[0x200000405:0x8a:0x0], offset: 0, type: SEEK_CUR, rc = 4096 00000080:00200008:2.0:1767316878.512641:0:81826:0:(file.c:424:ll_file_release()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), flags 100000 00010000:00010000:2.0:1767316878.512663:0:81826:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad56a0f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac1d0 expref: -99 pid: 81826 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316879.428756:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316880.459336:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1767316880.584924:0:81663:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x86:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767316880.584942:0:81663:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767316880.584969:0:81663:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x86:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1767316880.587794:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2505:1853163894004736:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316880.587877:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894004992:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316880.587904:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894005248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316880.587923:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1767316880.587926:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894004864:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316880.587938:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894005120:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316880.590920:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894004864:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316880.590940:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894005120:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316880.590949:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2505:1853163894004736:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316880.590958:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894004992:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316880.590968:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894005248:192.168.202.121@tcp:400:kworker.0 00010000:00010000:0.0:1767316881.482703:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316882.501418:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316883.524850:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316884.087983:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316884.088035:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939785088 00000100:00100000:2.0:1767316884.088046:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939785088 00000100:00100000:2.0:1767316884.088601:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10184 00000100:00100000:2.0:1767316884.088612:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:48909:x1853163939785088:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316884.088632:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316884.088707:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316884.088714:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:48909:x1853163939785088:12345-192.168.202.121@tcp:104: Request processed in 105us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316884.088721:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10184 00010000:00010000:2.0:1767316884.088873:0:63296:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1767316884.088881:0:63296:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316884.088890:0:63296:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2ce00 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:2.0:1767316884.088896:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400030000 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316884.088951:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316884.088959:0:63296:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767316884.088985:0:63296:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316884.089004:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad569c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x863eb2f6655ac0e9 expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316884.089024:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316884.089032:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316884.089034:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316884.089042:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767316884.089058:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894005376:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316884.112573:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894005376:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1767316884.548731:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1767316884.608984:0:82390:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 212a: Testing lfs setstripe --comp-set --comp-flags=stale --mirror-id ========================================================== 20:21:23 (1767316883) 00000080:00200000:0.0:1767316884.922876:0:82402:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316884.922906:0:82402:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316884.922922:0:82402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316884.922938:0:82402:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316884.922945:0:82402:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316884.922952:0:82402:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316884.922956:0:82402:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a01 00000080:00010000:0.0:1767316884.923017:0:82402:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a01 from it ffffa99f41c7bb58 00010000:00010000:0.0:1767316884.923022:0:82402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316884.923031:0:82402:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316884.923060:0:82402:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316884.923073:0:82402:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=13 00000080:00200000:0.0:1767316884.923103:0:82402:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316884.923119:0:82402:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316884.923174:0:82402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82402 initiator: MDT0 00010000:00010000:0.0:1767316884.923182:0:82402:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82402 initiator: MDT0 00010000:00010000:0.0:1767316884.923192:0:82402:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82402 initiator: MDT0 00000100:00100000:0.0:1767316884.923220:0:82402:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82402:1853163894005504:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316884.923327:0:82402:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316884.927317:0:82402:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937368 gen 1 00000100:00100000:1.0:1767316884.927358:0:82402:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe18f3f480 x1853163894004480/t8589937368(8589937368) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 656/744 e 0 to 0 dl 1767316894 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767316884.927371:0:82402:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82402:1853163894005504:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316884.927387:0:82402:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a16 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82402 initiator: MDT0 00010000:00010000:1.0:1767316884.927398:0:82402:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a16 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82402 initiator: MDT0 00010000:00010000:1.0:1767316884.927404:0:82402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a16 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82402 initiator: MDT0 00010000:00010000:1.0:1767316884.927411:0:82402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a16 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82402 initiator: MDT0 00010000:00010000:1.0:1767316884.927435:0:82402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a16 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82402 initiator: MDT0 00010000:00010000:1.0:1767316884.927441:0:82402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037ca00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316884.927445:0:82402:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a16 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 82402 initiator: MDT0 00010000:00010000:1.0:1767316884.927451:0:82402:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a16 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 82402 initiator: MDT0 00010000:00010000:1.0:1767316884.927457:0:82402:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a16 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 82402 initiator: MDT0 00010000:00010000:1.0:1767316884.927465:0:82402:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316884.927470:0:82402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a16 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82402 initiator: MDT0 00010000:00010000:1.0:1767316884.927476:0:82402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82402 initiator: MDT0 00000002:00100000:1.0:1767316884.927491:0:82402:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff9cfe191d8a80 x1853163894005504/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/584 e 0 to 0 dl 1767316900 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316884.927505:0:82402:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1767316884.927529:0:82402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.927541:0:82402:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767316884.927549:0:82402:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a01 from it ffffa99f41c7b940 00010000:00010000:1.0:1767316884.927552:0:82402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.927566:0:82402:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316884.927637:0:82402:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316884.927651:0:82402:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316884.927657:0:82402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.927666:0:82402:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316884.927671:0:82402:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316884.927676:0:82402:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316884.927679:0:82402:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a01 00000080:00010000:1.0:1767316884.927684:0:82402:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a01 from it ffffa99f41c7bbe8 00010000:00010000:1.0:1767316884.927687:0:82402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.927693:0:82402:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316884.927702:0:82402:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316884.927709:0:82402:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=16392 00000080:00200008:1.0:1767316884.927730:0:82402:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1767316884.927746:0:82402:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316884.927754:0:82402:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316884.927761:0:82402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.927775:0:82402:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316884.927782:0:82402:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316884.927797:0:82402:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316884.927800:0:82402:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a01 00000080:00010000:1.0:1767316884.927804:0:82402:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a01 from it ffffa99f41c7bcb8 00010000:00010000:1.0:1767316884.927807:0:82402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.927813:0:82402:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316884.928566:0:82402:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1767316884.928572:0:82402:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316884.928584:0:82402:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316884.928592:0:82402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.928603:0:82402:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316884.928609:0:82402:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316884.928614:0:82402:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316884.928616:0:82402:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a01 00000080:00010000:1.0:1767316884.928621:0:82402:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a01 from it ffffa99f41c7bcb8 00010000:00010000:1.0:1767316884.928624:0:82402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.928637:0:82402:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316884.928753:0:82402:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316884.928761:0:82402:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316884.928767:0:82402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.928775:0:82402:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316884.928780:0:82402:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316884.928976:0:82402:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316884.928979:0:82402:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a01 00000080:00010000:1.0:1767316884.928992:0:82402:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a01 from it ffffa99f41c7bb58 00010000:00010000:1.0:1767316884.928996:0:82402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.929002:0:82402:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316884.929011:0:82402:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316884.929018:0:82402:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=8 00000080:00200000:2.0:1767316884.929420:0:82402:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316884.929433:0:82402:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316884.929440:0:82402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316884.929449:0:82402:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316884.929456:0:82402:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316884.929460:0:82402:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316884.929463:0:82402:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a01 00000080:00010000:2.0:1767316884.929467:0:82402:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a01 from it ffffa99f41c7bbf8 00010000:00010000:2.0:1767316884.929470:0:82402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316884.929476:0:82402:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316884.929485:0:82402:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316884.929492:0:82402:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=777 00000080:00200000:2.0:1767316884.929495:0:82402:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316884.929501:0:82402:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316884.929505:0:82402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316884.929523:0:82402:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316884.929529:0:82402:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316884.929533:0:82402:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316884.929536:0:82402:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a01 00000080:00010000:2.0:1767316884.929540:0:82402:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a01 from it ffffa99f41c7bb38 00010000:00010000:2.0:1767316884.929543:0:82402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316884.929550:0:82402:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316884.929559:0:82402:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:2.0:1767316884.929563:0:82402:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), file ffff9cfe0518f200, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1767316884.929572:0:82402:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open|creat 00000002:00010000:2.0:1767316884.929593:0:82402:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1767316884.929605:0:82402:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316884.929655:0:82402:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316884.929662:0:82402:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767316884.929665:0:82402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56a01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac1a6 expref: -99 pid: 81825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316884.929711:0:82402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82402 initiator: MDT0 00010000:00010000:2.0:1767316884.929717:0:82402:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82402 initiator: MDT0 00000020:00100000:2.0:1767316884.929728:0:82402:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767316884.929753:0:82402:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29108380 x1853163894005760/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 536/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767316884.929783:0:82402:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82402 initiator: MDT0 00000100:00100000:2.0:1767316884.929954:0:82402:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82402:1853163894005760:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316884.930310:0:82402:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe061e9180 going to sleep for 11 seconds 00000100:00100000:0.0:1767316884.952298:0:82402:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82402:1853163894005760:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316884.952325:0:82402:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.960117:0:82402:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.960136:0:82402:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.960166:0:82402:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.960178:0:82402:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.960579:0:82402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.960588:0:82402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.960595:0:82402:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316884.960610:0:82402:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff9cfe29108380 x1853163894005760/t8589937369(8589937369) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 536/608 e 0 to 0 dl 1767316900 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316884.960623:0:82402:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29108380 x1853163894005760/t8589937369(8589937369) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 536/608 e 0 to 0 dl 1767316900 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316884.960636:0:82402:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.960647:0:82402:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767316884.960654:0:82402:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316884.960667:0:82402:0:(namei.c:1569:ll_create_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open|creat 00000080:00200000:1.0:1767316884.960694:0:82402:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00200000:1.0:1767316884.960701:0:82402:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 0 00000080:00200000:1.0:1767316884.960752:0:82402:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1767316884.960759:0:82402:0:(namei.c:1535:ll_create_node()) setting l_ast_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:1.0:1767316884.960762:0:82402:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a1d 00000080:00010000:1.0:1767316884.960772:0:82402:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00200008:1.0:1767316884.960796:0:82402:0:(file.c:1001:ll_file_open()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), flags 120501 00000002:00100000:1.0:1767316884.960819:0:82402:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29108380 x1853163894005760/t8589937369(8589937369) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 536/608 e 0 to 0 dl 1767316900 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767316884.960852:0:82402:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a1d from it ffff9cfe09ee9e40 00010000:00010000:1.0:1767316884.960857:0:82402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.960865:0:82402:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316884.960886:0:82402:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), inode mode 81a4 mask 40 00000080:00200000:1.0:1767316884.960940:0:82402:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), inode mode 81a4 mask 2 00000080:00200000:1.0:1767316884.960949:0:82402:0:(xattr.c:406:ll_xattr_set()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), xattr lov 00000002:00010000:1.0:1767316884.960969:0:82402:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:1.0:1767316884.961039:0:82402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56a24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82402 initiator: MDT0 00010000:00010000:1.0:1767316884.961046:0:82402:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56a24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82402 initiator: MDT0 00000020:00100000:1.0:1767316884.961058:0:82402:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316884.961359:0:82402:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3ca80 x1853163894006016/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316884.961370:0:82402:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56a24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82402 initiator: MDT0 00000100:00100000:1.0:1767316884.961405:0:82402:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ca80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82402:1853163894006016:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316884.961660:0:82402:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255d80 going to sleep for 11 seconds 00000100:00100000:2.0:1767316884.967241:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316884.967281:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939785216 00000100:00100000:2.0:1767316884.967291:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939785216 00000100:00100000:2.0:1767316884.967341:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10185 00000100:00100000:2.0:1767316884.967350:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15469:x1853163939785216:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316884.967367:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316884.967443:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316884.967450:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15469:x1853163939785216:12345-192.168.202.121@tcp:104: Request processed in 102us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316884.967457:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10185 00010000:00010000:1.0:1767316884.967587:0:63143:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316884.967595:0:63143:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.967604:0:63143:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05094000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316884.967610:0:63143:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.967620:0:63143:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.967628:0:63143:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316884.967655:0:63143:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:1.0:1767316884.967698:0:63143:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.967706:0:63143:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316884.967727:0:63143:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.967742:0:63143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad56a1d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac20f expref: -99 pid: 82402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316884.967761:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316884.967763:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316884.967777:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316884.967806:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894006144:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316884.979601:0:82402:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ca80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82402:1853163894006016:192.168.202.121@tcp:101:lfs.0 00010000:00010000:3.0:1767316884.979623:0:82402:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56a24 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82402 initiator: MDT0 00010000:00010000:3.0:1767316884.979636:0:82402:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56a24 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 82402 initiator: MDT0 00010000:00010000:3.0:1767316884.979644:0:82402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56a24 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 82402 initiator: MDT0 00010000:00010000:3.0:1767316884.979652:0:82402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56a24 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 82402 initiator: MDT0 00010000:00010000:3.0:1767316884.979677:0:82402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56a24 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 82402 initiator: MDT0 00010000:00010000:3.0:1767316884.979684:0:82402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:3.0:1767316884.979689:0:82402:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56a24 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 82402 initiator: MDT0 00010000:00010000:3.0:1767316884.979696:0:82402:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56a24 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 82402 initiator: MDT0 00010000:00010000:3.0:1767316884.979703:0:82402:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56a24 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 82402 initiator: MDT0 00010000:00010000:3.0:1767316884.979709:0:82402:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1767316884.979715:0:82402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56a24 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 82402 initiator: MDT0 00010000:00010000:3.0:1767316884.979721:0:82402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56a24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 82402 initiator: MDT0 00000002:00100000:3.0:1767316884.979752:0:82402:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=800002b, status=0 req@ffff9cfe18f3ca80 x1853163894006016/t8589937370(8589937370) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316900 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767316884.979766:0:82402:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3ca80 x1853163894006016/t8589937370(8589937370) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316900 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767316884.979783:0:82402:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767316884.979833:0:82402:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1767316884.979841:0:82402:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316884.979882:0:82402:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 0 00000002:00100000:3.0:1767316884.979897:0:82402:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3ca80 x1853163894006016/t8589937370(8589937370) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316900 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767316884.979939:0:82402:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3ca80 x1853163894006016/t8589937370(8589937370) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316900 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767316884.979948:0:82402:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767316884.979953:0:82402:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18fd7b80 x1853163894006400/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767316884.979974:0:82402:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82402:1853163894006400:192.168.202.121@tcp:35:lfs.0 00000100:00100000:3.0:1767316884.980070:0:82402:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0f381000 going to sleep for 11 seconds 00000100:00100000:3.0:1767316884.983471:0:82402:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82402:1853163894006400:192.168.202.121@tcp:35:lfs.0 00000002:00100000:3.0:1767316884.983505:0:82402:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3ca80 x1853163894006016/t8589937370(8589937370) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316900 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1767316884.983560:0:82402:0:(file.c:424:ll_file_release()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), flags 100001 00000002:00100000:3.0:1767316884.983614:0:82402:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe29108380 x1853163894005760/t8589937369(8589937369) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 536/608 e 0 to 0 dl 1767316900 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767316884.983624:0:82402:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767316884.983629:0:82402:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18fd5c00 x1853163894006656/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767316884.983648:0:82402:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82402:1853163894006656:192.168.202.121@tcp:35:lfs.0 00000100:00100000:3.0:1767316884.983776:0:82402:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0f381000 going to sleep for 11 seconds 00000100:00100000:1.0:1767316884.986857:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894006144:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316884.990601:0:82402:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82402:1853163894006656:192.168.202.121@tcp:35:lfs.0 00000002:00100000:3.0:1767316884.990638:0:82402:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe29108380 x1853163894005760/t8589937369(8589937369) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 536/608 e 0 to 0 dl 1767316900 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316884.995795:0:82258:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316884.995828:0:82258:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316884.995890:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82258 initiator: MDT0 00010000:00010000:0.0:1767316884.995900:0:82258:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82258 initiator: MDT0 00010000:00010000:0.0:1767316884.995910:0:82258:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82258 initiator: MDT0 00000100:00100000:0.0:1767316884.995951:0:82258:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894006784:192.168.202.121@tcp:101:bash.0 00000100:00100000:0.0:1767316884.996485:0:82258:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316884.999963:0:82258:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894006784:192.168.202.121@tcp:101:bash.0 00010000:00010000:0.0:1767316885.000016:0:82258:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.000028:0:82258:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.000039:0:82258:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.000050:0:82258:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.000062:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.000707:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.000717:0:82258:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316885.000731:0:82258:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191da300 x1853163894006784/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316900 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316885.000758:0:82258:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.000782:0:82258:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316885.000801:0:82258:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316885.000829:0:82258:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316885.000835:0:82258:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a2b 00000080:00010000:0.0:1767316885.000841:0:82258:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316885.000844:0:82258:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a2b from it ffffa99f419afbf8 00010000:00010000:0.0:1767316885.000847:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.000856:0:82258:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316885.000880:0:82258:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316885.000901:0:82258:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316885.000917:0:82258:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316885.000926:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.000937:0:82258:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316885.000943:0:82258:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316885.000947:0:82258:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316885.000951:0:82258:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a2b 00000080:00010000:0.0:1767316885.000954:0:82258:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a2b from it ffffa99f419afb38 00010000:00010000:0.0:1767316885.000958:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.000976:0:82258:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316885.001000:0:82258:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316885.001006:0:82258:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), file ffff9cfe027f3980, open_flags 8241, mode 81b6 opened 0 00000080:00200000:0.0:1767316885.001016:0:82258:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open|creat 00000002:00010000:0.0:1767316885.001037:0:82258:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x200000405:0x8f:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0101102 00010000:00010000:0.0:1767316885.001050:0:82258:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.001353:0:82258:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.001361:0:82258:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316885.001364:0:82258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac239 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.001395:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82258 initiator: MDT0 00010000:00010000:0.0:1767316885.001402:0:82258:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82258 initiator: MDT0 00000020:00100000:0.0:1767316885.001413:0:82258:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316885.001420:0:82258:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191da300 x1853163894007040/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316885.001428:0:82258:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82258 initiator: MDT0 00000100:00100000:0.0:1767316885.001457:0:82258:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894007040:192.168.202.121@tcp:101:bash.0 00000100:00100000:0.0:1767316885.001624:0:82258:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316885.009049:0:82258:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894007040:192.168.202.121@tcp:101:bash.0 00010000:00010000:0.0:1767316885.009076:0:82258:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac255 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.009189:0:82258:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac255 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.009198:0:82258:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac255 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.009210:0:82258:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac255 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.009220:0:82258:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac255 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.009232:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac255 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.009240:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac255 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.009248:0:82258:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac255 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316885.009260:0:82258:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=2b, status=0 req@ffff9cfe191da300 x1853163894007040/t8589937373(8589937373) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316885.009289:0:82258:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191da300 x1853163894007040/t8589937373(8589937373) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316885.009302:0:82258:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac255 expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316885.009314:0:82258:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac255 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.009324:0:82258:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:0.0:1767316885.009331:0:82258:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316885.009376:0:82258:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8e:0x0](ffff9cfe0edb42c8): rc = 0 00000080:00200000:0.0:1767316885.009391:0:82258:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:0.0:1767316885.009396:0:82258:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a32 00000080:00010000:0.0:1767316885.009407:0:82258:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00200008:0.0:1767316885.009421:0:82258:0:(file.c:1001:ll_file_open()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), flags 101101 00000002:00100000:0.0:1767316885.009443:0:82258:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191da300 x1853163894007040/t8589937373(8589937373) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 776/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767316885.009472:0:82258:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a32 from it ffff9cfe2751c7e0 00010000:00010000:0.0:1767316885.009476:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac255 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.009483:0:82258:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac255 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.009503:0:82258:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), inode mode 81a4 mask 42 00000002:00010000:0.0:1767316885.009528:0:82258:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x8e:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1767316885.009574:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56a39 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82258 initiator: MDT0 00010000:00010000:0.0:1767316885.009581:0:82258:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56a39 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82258 initiator: MDT0 00010000:00010000:0.0:1767316885.009589:0:82258:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56a39 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82258 initiator: MDT0 00000100:00100000:0.0:1767316885.009611:0:82258:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894007168:192.168.202.121@tcp:101:bash.0 00000100:00100000:0.0:1767316885.009701:0:82258:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316885.011727:0:82258:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894007168:192.168.202.121@tcp:101:bash.0 00010000:00010000:0.0:1767316885.011749:0:82258:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56a39 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac26a expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.011761:0:82258:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56a39 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac26a expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.011770:0:82258:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56a39 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac26a expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316885.011781:0:82258:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=80 disposition=0, status=0 req@ffff9cfe191dbb80 x1853163894007168/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 568/1336 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316885.011790:0:82258:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56a39 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac26a expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.011802:0:82258:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:0.0:1767316885.011807:0:82258:0:(namei.c:955:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x8e:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1767316885.011832:0:82258:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a39 00000080:00010000:0.0:1767316885.011838:0:82258:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a39 from it ffffa99f419afa48 00010000:00010000:0.0:1767316885.011853:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56a39 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac26a expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.011861:0:82258:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56a39 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac26a expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316885.011894:0:82258:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1767316885.000000000, mtime 1767316885.000000000, ctime 1767316885.000000000 00010000:00010000:0.0:1767316885.011919:0:82258:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac255 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.011936:0:82258:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:0.0:1767316885.011969:0:82258:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac255 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.011975:0:82258:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316885.011978:0:82258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a32 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac255 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767316885.012012:0:82258:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316885.012019:0:82258:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191dbb80 x1853163894007424/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316885.012037:0:82258:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894007424:192.168.202.121@tcp:36:bash.0 00000100:00100000:0.0:1767316885.012137:0:82258:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316885.016703:0:82258:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894007424:192.168.202.121@tcp:36:bash.0 00000080:00200000:0.0:1767316885.016748:0:82258:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1767316885.016754:0:82258:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:0.0:1767316885.016772:0:82258:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 31 res 8589935621/142 (0 0) 00000080:00010000:0.0:1767316885.016794:0:82258:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000002:00010000:0.0:1767316885.016805:0:82258:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: layout flags 0 00010000:00010000:0.0:1767316885.016850:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82258 initiator: MDT0 00010000:00010000:0.0:1767316885.016858:0:82258:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82258 initiator: MDT0 00010000:00010000:0.0:1767316885.016868:0:82258:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82258 initiator: MDT0 00000100:00100000:0.0:1767316885.016889:0:82258:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894007552:192.168.202.121@tcp:101:bash.0 00000100:00100000:0.0:1767316885.016960:0:82258:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316885.018575:0:82258:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894007552:192.168.202.121@tcp:101:bash.0 00010000:00010000:0.0:1767316885.018599:0:82258:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac278 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.018612:0:82258:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac278 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316885.018625:0:82258:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe191d9c00 x1853163894007552/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/584 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316885.018634:0:82258:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac278 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767316885.018646:0:82258:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac278 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.018657:0:82258:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/142 (0 0) 00000080:00200000:0.0:1767316885.018674:0:82258:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316885.018690:0:82258:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a40 00000080:00010000:0.0:1767316885.018697:0:82258:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a40 from it ffffa99f419af8c8 00010000:00010000:0.0:1767316885.018701:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac278 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.018709:0:82258:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac278 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.018728:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac278 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.018738:0:82258:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac278 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316885.018745:0:82258:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8e:0x0](000000004aa96abd) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac278 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.018783:0:82258:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4294967294 -> 2 00010000:00010000:0.0:1767316885.018788:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac278 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.018795:0:82258:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac278 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00020000:00200000:0.0:1767316885.018809:0:82258:0:(lov_io.c:385:lov_io_mirror_init()) [0x200000405:0x8e:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1767316885.018816:0:82258:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 2 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316885.018819:0:82258:0:(vvp_io.c:356:vvp_io_fini()) [0x200000405:0x8e:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1767316885.018826:0:82258:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000002:00010000:0.0:1767316885.018840:0:82258:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: layout flags 02 00010000:00010000:0.0:1767316885.018853:0:82258:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac278 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.018866:0:82258:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:0.0:1767316885.018892:0:82258:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac278 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.018899:0:82258:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316885.018902:0:82258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a40 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac278 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.018923:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82258 initiator: MDT0 00010000:00010000:0.0:1767316885.018929:0:82258:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82258 initiator: MDT0 00000020:00100000:0.0:1767316885.018939:0:82258:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316885.018946:0:82258:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9c00 x1853163894007808/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/1976 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316885.018955:0:82258:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82258 initiator: MDT0 00000100:00100000:0.0:1767316885.018972:0:82258:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894007808:192.168.202.121@tcp:101:bash.0 00000100:00100000:0.0:1767316885.019051:0:82258:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316885.031201:0:82258:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937376 gen 1 00000100:00100000:0.0:1767316885.031274:0:82258:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe191da300 x1853163894007040/t8589937373(8589937373) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 776/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767316885.031293:0:82258:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894007808:192.168.202.121@tcp:101:bash.0 00010000:00010000:0.0:1767316885.031326:0:82258:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.031336:0:82258:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 4/0,1 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.031347:0:82258:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.031358:0:82258:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.031370:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.031377:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.031384:0:82258:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316885.031394:0:82258:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe191d9c00 x1853163894007808/t8589937376(8589937376) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/584 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316885.031412:0:82258:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767316885.031424:0:82258:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.031447:0:82258:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/142 (0 0) 00000080:00200000:0.0:1767316885.031454:0:82258:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316885.031465:0:82258:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a47 00000080:00010000:0.0:1767316885.031474:0:82258:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a47 from it ffffa99f419af930 00010000:00010000:0.0:1767316885.031478:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.031485:0:82258:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.031503:0:82258:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1767316885.031510:0:82258:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00010000:00010000:0.0:1767316885.031523:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.031535:0:82258:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316885.031542:0:82258:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8e:0x0](000000004aa96abd) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.031578:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.031586:0:82258:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.031599:0:82258:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316885.031617:0:82258:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316885.031620:0:82258:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316885.031626:0:82258:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316885.031653:0:82258:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1767316885.031667:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.031676:0:82258:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316885.031683:0:82258:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8e:0x0](000000004aa96abd) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.031699:0:82258:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316885.031704:0:82258:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316885.031707:0:82258:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316885.031709:0:82258:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316885.031717:0:82258:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316885.031777:0:82258:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1767316885.031782:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.031791:0:82258:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00020000:00200000:0.0:1767316885.031802:0:82258:0:(lov_io.c:308:lov_io_mirror_write_intent()) [0x200000405:0x8e:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1767316885.031806:0:82258:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316885.031809:0:82258:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316885.031813:0:82258:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316885.031828:0:82258:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1767316885.031840:0:82258:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1767316885.031844:0:82258:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9030, osc lock ffff9cfe201db300, flags 0x80000000 00010000:00010000:0.0:1767316885.031889:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.031898:0:82258:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.031908:0:82258:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316885.031930:0:82258:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894007936:192.168.202.121@tcp:101:bash.0 00000100:00100000:0.0:1767316885.032031:0:82258:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316885.037730:0:82258:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9cfe08c17800: committing for last_committed 17179875386 gen 1 00000100:00100000:0.0:1767316885.037761:0:82258:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894007936:192.168.202.121@tcp:101:bash.0 00010000:00010000:0.0:1767316885.037789:0:82258:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.037806:0:82258:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.037821:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316885.037835:0:82258:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.037863:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.037871:0:82258:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316885.038062:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894008064:192.168.202.121@tcp:10:bash.0 00000100:00100000:1.0:1767316885.046303:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894008064:192.168.202.121@tcp:10:bash.0 00000080:00200000:0.0:1767316885.046401:0:82258:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1767316885.046408:0:82258:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284038 (ffff9cfe0e4c8a28/0) at cl_lock_release():245 00000020:00010000:0.0:1767316885.046412:0:82258:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284038 (ffff9cfe0e4c8a28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316885.046417:0:82258:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9030 (ffff9cfe0e4c85a8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1767316885.046428:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.046443:0:82258:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000020:00010000:0.0:1767316885.046461:0:82258:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284038 (ffff9cfe0e4c8a28/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316885.046464:0:82258:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9030 (ffff9cfe0e4c8a28/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316885.046483:0:82258:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767316885.046496:0:82258:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) current size 0, valid attrs a168, mode 0, uid 2, gid 0, new size 0, atime 1767316885.000000000, mtime 1767316885.000000000, ctime 1767316885.000000000, rc 0 00000080:00200008:0.0:1767316885.046586:0:82258:0:(file.c:2648:do_file_write_iter()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], ppos: 0, count: 14 00000080:00200000:0.0:1767316885.046600:0:82258:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 14 bytes 00000080:00200000:0.0:1767316885.046607:0:82258:0:(file.c:2624:ll_do_tiny_write()) result: 0, original count 14 00000080:00200000:0.0:1767316885.046613:0:82258:0:(file.c:1994:ll_file_io_generic()) f212a.sanity-flr: write ppos: 0, bytes: 14 00000080:00200000:0.0:1767316885.046632:0:82258:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 0 00000020:00200000:0.0:1767316885.046641:0:82258:0:(cl_io.c:214:cl_io_rw_init()) header@00000000698bd428[0x4, 1, [0x200000405:0x8e:0x0] hash] 00000020:00200000:0.0:1767316885.046643:0:82258:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 14) 0 0 00000080:00200000:0.0:1767316885.046647:0:82258:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:0.0:1767316885.046660:0:82258:0:(lov_io.c:308:lov_io_mirror_write_intent()) [0x200000405:0x8e:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 2 00020000:00200000:0.0:1767316885.046665:0:82258:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316885.046668:0:82258:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:0.0:1767316885.046674:0:82258:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1767316885.046680:0:82258:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 14) 14, 14 00020000:00200000:0.0:1767316885.046683:0:82258:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316885.046699:0:82258:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1767316885.046713:0:82258:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1767316885.046718:0:82258:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9030, osc lock ffff9cfe201db300, flags 0x0 00010000:00010000:0.0:1767316885.046738:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.046752:0:82258:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.046764:0:82258:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 6/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.046773:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 6/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.046780:0:82258:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316885.046791:0:82258:0:(vvp_io.c:1312:vvp_io_write_start()) f212a.sanity-flr: write [0, 14) append 0 append lockpos 0 00000080:00200000:0.0:1767316885.046800:0:82258:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 14 bytes 00000080:00200000:0.0:1767316885.046891:0:82258:0:(rw26.c:912:ll_write_end()) pos 0, len 14, copied 14 00000080:00200000:0.0:1767316885.046899:0:82258:0:(rw26.c:969:ll_write_end()) page@0000000002abfa4a[3 00000000a9fddd80 2 1 00000000688aea25] 00000080:00200000:0.0:1767316885.046903:0:82258:0:(rw26.c:969:ll_write_end()) vmpage @00000000cff180d8 17ffffc0001021 2:0 ffff9cfe07ba25e8 0 lru 00000080:00200000:0.0:1767316885.046911:0:82258:0:(rw26.c:969:ll_write_end()) osc-page@0000000086498ec1 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000f9009730 0000000003c7772d > 3< 0 0 > 4< 0 0 8 484638720 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1767316885.046913:0:82258:0:(rw26.c:969:ll_write_end()) end page@0000000002abfa4a 00000080:00200000:0.0:1767316885.046915:0:82258:0:(rw26.c:969:ll_write_end()) queued page: 1. 00000080:00200000:0.0:1767316885.046919:0:82258:0:(vvp_io.c:1193:vvp_io_write_commit()) commit async pages: 1, from 0, to 14 prio 0 00000008:00010000:0.0:1767316885.046940:0:82258:0:(osc_cache.c:814:osc_extent_find()) ### extent: 000000002f4477a8 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316885.046958:0:82258:0:(vvp_io.c:1106:vvp_set_batch_dirty()) mapping ffff9cfe0edb4478, count 1, dirtied 1 00000080:00200000:0.0:1767316885.046962:0:82258:0:(vvp_io.c:1216:vvp_io_write_commit()) Committed 1 pages 14 bytes, tot: 14 00000080:00200000:0.0:1767316885.046965:0:82258:0:(vvp_io.c:1390:vvp_io_write_start()) f212a.sanity-flr: write bytes 0, result: 14 00000020:00010000:0.0:1767316885.046977:0:82258:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284038 (ffff9cfe0e4c8a28/0) at cl_lock_release():245 00000020:00010000:0.0:1767316885.046979:0:82258:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284038 (ffff9cfe0e4c8a28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316885.046995:0:82258:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9030 (ffff9cfe0e4c85a8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1767316885.047000:0:82258:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.047008:0:82258:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000020:00010000:0.0:1767316885.047018:0:82258:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284038 (ffff9cfe0e4c8a28/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316885.047021:0:82258:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9030 (ffff9cfe0e4c8a28/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316885.047026:0:82258:0:(vvp_io.c:518:vvp_io_advance()) advancing 14 bytes 00000080:00200000:0.0:1767316885.047030:0:82258:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767316885.047035:0:82258:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316885.047039:0:82258:0:(file.c:2142:ll_file_io_generic()) f212a.sanity-flr: 2 io complete with rc: 0, result: 14, restart: 0 00000080:00200000:0.0:1767316885.047045:0:82258:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 0 00000080:00200000:0.0:1767316885.047048:0:82258:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 14 00000080:00200008:0.0:1767316885.047072:0:82258:0:(file.c:424:ll_file_release()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), flags 100001 00000002:00100000:0.0:1767316885.047165:0:82258:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191da300 x1853163894007040/t8589937373(8589937373) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 776/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316885.047177:0:82258:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316885.047182:0:82258:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191dbb80 x1853163894008320/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316885.047203:0:82258:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894008320:192.168.202.121@tcp:35:bash.0 00000100:00100000:0.0:1767316885.047290:0:82258:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316885.051429:0:82258:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82258:1853163894008320:192.168.202.121@tcp:35:bash.0 00000002:00100000:0.0:1767316885.051466:0:82258:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191da300 x1853163894007040/t8589937373(8589937373) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 776/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316885.075513:0:82404:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316885.075548:0:82404:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316885.075623:0:82404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82404 initiator: MDT0 00010000:00010000:1.0:1767316885.075636:0:82404:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82404 initiator: MDT0 00010000:00010000:1.0:1767316885.075647:0:82404:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82404 initiator: MDT0 00000100:00100000:1.0:1767316885.075679:0:82404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82404:1853163894008448:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316885.076019:0:82404:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316885.080680:0:82404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82404:1853163894008448:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316885.080708:0:82404:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.080722:0:82404:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.080734:0:82404:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.080758:0:82404:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.080770:0:82404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.080778:0:82404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.080785:0:82404:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316885.080797:0:82404:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3ce00 x1853163894008448/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316885.080811:0:82404:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.080825:0:82404:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316885.080833:0:82404:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316885.080860:0:82404:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316885.080866:0:82404:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:1.0:1767316885.080872:0:82404:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316885.080875:0:82404:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f40c8fbf8 00010000:00010000:1.0:1767316885.080878:0:82404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.080886:0:82404:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316885.080916:0:82404:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316885.080931:0:82404:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), file ffff9cfe09e4f680, open_flags 18800, mode 0 opened 0 00000080:00200000:1.0:1767316885.080938:0:82404:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open 00000002:00010000:1.0:1767316885.080959:0:82404:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0304001 00010000:00010000:1.0:1767316885.081018:0:82404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82404 initiator: MDT0 00010000:00010000:1.0:1767316885.081026:0:82404:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82404 initiator: MDT0 00000020:00100000:1.0:1767316885.081036:0:82404:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316885.081043:0:82404:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3ce00 x1853163894008704/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316885.081051:0:82404:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82404 initiator: MDT0 00000100:00100000:1.0:1767316885.081316:0:82404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82404:1853163894008704:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316885.081531:0:82404:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316885.085903:0:82404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82404:1853163894008704:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316885.085921:0:82404:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a5c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82404 initiator: MDT0 00010000:00010000:1.0:1767316885.085931:0:82404:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a5c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82404 initiator: MDT0 00010000:00010000:1.0:1767316885.085936:0:82404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a5c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82404 initiator: MDT0 00010000:00010000:1.0:1767316885.085955:0:82404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a5c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82404 initiator: MDT0 00010000:00010000:1.0:1767316885.085961:0:82404:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a5c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82404 initiator: MDT0 00010000:00010000:1.0:1767316885.085965:0:82404:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316885.085968:0:82404:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a5c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82404 initiator: MDT0 00010000:00010000:1.0:1767316885.085972:0:82404:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a5c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82404 initiator: MDT0 00010000:00010000:1.0:1767316885.085977:0:82404:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a5c lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 82404 initiator: MDT0 00010000:00010000:1.0:1767316885.085981:0:82404:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316885.085999:0:82404:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a5c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82404 initiator: MDT0 00010000:00010000:1.0:1767316885.086004:0:82404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82404 initiator: MDT0 00000002:00100000:1.0:1767316885.086018:0:82404:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=-20 req@ffff9cfe18f3ce00 x1853163894008704/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/608 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316885.086028:0:82404:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc -20 00000080:00200000:1.0:1767316885.086179:0:82404:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316885.086209:0:82404:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316885.086221:0:82404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.086245:0:82404:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316885.086253:0:82404:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316885.086258:0:82404:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316885.086263:0:82404:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:1.0:1767316885.086269:0:82404:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f40c8fbb0 00010000:00010000:1.0:1767316885.086272:0:82404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.086280:0:82404:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316885.086291:0:82404:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 44 00000080:00200008:1.0:1767316885.086300:0:82404:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags 304000 00000080:00200080:1.0:1767316885.086330:0:82404:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148) cmd=c0086915 arg=22b03d0 00000100:00100000:1.0:1767316885.086378:0:82404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82404:1853163894008832:192.168.202.121@tcp:34:lfs.0 00000100:00100000:1.0:1767316885.086446:0:82404:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316885.089789:0:82404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82404:1853163894008832:192.168.202.121@tcp:34:lfs.0 00000080:00200008:1.0:1767316885.090824:0:82404:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags 304000 00000080:00200000:0.0:1767316885.114027:0:82406:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316885.114057:0:82406:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316885.114104:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.114121:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316885.114130:0:82406:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316885.114137:0:82406:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316885.114141:0:82406:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:0.0:1767316885.114147:0:82406:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f415fbb58 00010000:00010000:0.0:1767316885.114151:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.114160:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316885.114181:0:82406:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316885.114195:0:82406:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=9 00000080:00200000:0.0:1767316885.114199:0:82406:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316885.114212:0:82406:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316885.114255:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82406 initiator: MDT0 00010000:00010000:0.0:1767316885.114263:0:82406:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82406 initiator: MDT0 00010000:00010000:0.0:1767316885.114271:0:82406:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82406 initiator: MDT0 00000100:00100000:0.0:1767316885.114296:0:82406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894008960:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316885.114394:0:82406:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316885.125315:0:82406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894008960:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316885.125344:0:82406:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.125362:0:82406:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.125371:0:82406:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.125383:0:82406:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.125412:0:82406:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.125424:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.125433:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.125440:0:82406:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316885.125451:0:82406:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191dbb80 x1853163894008960/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/824 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316885.125462:0:82406:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316885.125474:0:82406:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.125484:0:82406:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:0.0:1767316885.125490:0:82406:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316885.125537:0:82406:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8e:0x0](ffff9cfe0edb42c8): rc = 0 00000080:00200000:0.0:1767316885.125550:0:82406:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 3 -> 3 00000080:00010000:0.0:1767316885.125555:0:82406:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a63 00000080:00010000:0.0:1767316885.125566:0:82406:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:0.0:1767316885.125569:0:82406:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a63 from it ffffa99f415fbb20 00010000:00010000:0.0:1767316885.125577:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.125586:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316885.125626:0:82406:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316885.125633:0:82406:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:0.0:1767316885.125656:0:82406:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316885.125664:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.125674:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.125680:0:82406:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316885.125684:0:82406:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:0.0:1767316885.125687:0:82406:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a63 00000080:00010000:0.0:1767316885.125691:0:82406:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a63 from it ffffa99f415fbcb8 00010000:00010000:0.0:1767316885.125694:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.125701:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.125717:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:0.0:1767316885.125728:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316885.125743:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316885.125747:0:82406:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:0.0:1767316885.125770:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316885.125773:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9030, osc lock ffff9cfe201db300, flags 0x400000400001002 00010000:00010000:0.0:1767316885.125789:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.125798:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316885.125811:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316885.125815:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.125822:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316885.125832:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316885.125841:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 0 00000020:00010000:0.0:1767316885.125847:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_release():245 00000020:00010000:0.0:1767316885.125850:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316885.125852:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9030 (ffff9cfe0e4c85a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316885.125856:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316885.125858:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9030 (ffff9cfe0e4c8a28/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316885.125867:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316885.125907:0:82406:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316885.125916:0:82406:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316885.125922:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.125939:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316885.125946:0:82406:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316885.125950:0:82406:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316885.125953:0:82406:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:0.0:1767316885.125957:0:82406:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f415fbbf8 00010000:00010000:0.0:1767316885.125960:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.125966:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316885.125974:0:82406:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316885.125995:0:82406:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=265 00000080:00200000:0.0:1767316885.126002:0:82406:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), inode mode 81a4 mask 46 00000080:00200008:0.0:1767316885.126010:0:82406:0:(file.c:1001:ll_file_open()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), flags 154402 00000002:00010000:0.0:1767316885.126025:0:82406:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114403 00010000:00010000:0.0:1767316885.126472:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82406 initiator: MDT0 00010000:00010000:0.0:1767316885.126480:0:82406:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82406 initiator: MDT0 00000020:00100000:0.0:1767316885.126493:0:82406:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316885.126501:0:82406:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191dbb80 x1853163894009216/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316885.126509:0:82406:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82406 initiator: MDT0 00000100:00100000:0.0:1767316885.126537:0:82406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894009216:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316885.126761:0:82406:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316885.135133:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316885.135574:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939787264 00000100:00100000:3.0:1767316885.135593:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939787264 00000100:00100000:3.0:1767316885.135694:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10186 00000100:00100000:3.0:1767316885.135705:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939787264:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316885.135723:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316885.135818:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316885.135826:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939787264:12345-192.168.202.121@tcp:104: Request processed in 124us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316885.135833:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10186 00010000:00010000:0.0:1767316885.135895:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316885.135903:0:59093:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.135912:0:59093:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037ca00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316885.135917:0:59093:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.135925:0:59093:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.135933:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.135959:0:59093:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.136015:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.136022:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316885.136054:0:59093:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.136071:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a63 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac2e1 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.136122:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.136124:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.136125:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316885.136146:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894009344:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316885.142062:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894009344:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316885.142381:0:82406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894009216:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316885.142402:0:82406:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.142419:0:82406:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.142427:0:82406:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.142439:0:82406:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.142450:0:82406:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.142462:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.142469:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.142476:0:82406:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316885.142503:0:82406:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe191dbb80 x1853163894009216/t8589937378(8589937378) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316885.142515:0:82406:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191dbb80 x1853163894009216/t8589937378(8589937378) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316885.142530:0:82406:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.142540:0:82406:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 8 res 8589935621/142 (0 0) 00000080:00200000:0.0:1767316885.142546:0:82406:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316885.142590:0:82406:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a6a 00000080:00010000:0.0:1767316885.142596:0:82406:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a6a from it ffffa99f415fbbf0 00010000:00010000:0.0:1767316885.142599:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.142606:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316885.142631:0:82406:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191dbb80 x1853163894009216/t8589937378(8589937378) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316885.142879:0:82406:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1767316885.142888:0:82406:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), xattr lov 00000080:00200008:0.0:1767316885.142917:0:82406:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316885.142924:0:82406:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:0.0:1767316885.142939:0:82406:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316885.142947:0:82406:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 30 res 8589935621/142 (0 0) 00010000:00010000:0.0:1767316885.143004:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82406 initiator: MDT0 00010000:00010000:0.0:1767316885.143012:0:82406:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82406 initiator: MDT0 00010000:00010000:0.0:1767316885.143022:0:82406:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82406 initiator: MDT0 00000100:00100000:0.0:1767316885.143042:0:82406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894009472:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316885.144077:0:82406:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1767316885.147005:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316885.147326:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939787392 00000100:00100000:2.0:1767316885.147336:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939787392 00000100:00100000:2.0:1767316885.147639:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10187 00000100:00100000:2.0:1767316885.147651:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939787392:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316885.147671:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.147813:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316885.147821:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939787392:12345-192.168.202.121@tcp:104: Request processed in 173us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316885.147828:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10187 00010000:00010000:0.0:1767316885.149999:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316885.150015:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.150026:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037d800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316885.150032:0:42049:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.150040:0:42049:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.150050:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.150147:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 2/0,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.150152:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316885.150171:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 1/0,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.150194:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56a6a lrc: 0/0,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac2ef expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.150209:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.150211:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.150212:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316885.150287:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894009600:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316885.153072:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894009600:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316885.153942:0:82406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894009472:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316885.153963:0:82406:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac304 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.153974:0:82406:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac304 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.153995:0:82406:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac304 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.154006:0:82406:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac304 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.154018:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac304 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.154025:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac304 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.154031:0:82406:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac304 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316885.154055:0:82406:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191db100 x1853163894009472/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/824 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316885.154066:0:82406:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac304 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316885.154115:0:82406:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac304 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.154131:0:82406:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:0.0:1767316885.154138:0:82406:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316885.154192:0:82406:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 3 -> 3 00000080:00010000:0.0:1767316885.154198:0:82406:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a71 00000080:00010000:0.0:1767316885.154203:0:82406:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:0.0:1767316885.154206:0:82406:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a71 from it ffffa99f415fbcd8 00010000:00010000:0.0:1767316885.154209:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac304 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.154217:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac304 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.154245:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:0.0:1767316885.154257:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316885.154260:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316885.154263:0:82406:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:0.0:1767316885.154280:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316885.154284:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9030, osc lock ffff9cfe201db300, flags 0x400000400001002 00010000:00010000:0.0:1767316885.154299:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.154317:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316885.154328:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316885.154332:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.154339:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316885.154349:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316885.154358:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 0 00000020:00010000:0.0:1767316885.154363:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_release():245 00000020:00010000:0.0:1767316885.154365:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316885.154367:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9030 (ffff9cfe0e4c85a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316885.154370:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316885.154372:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9030 (ffff9cfe0e4c8a28/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316885.154380:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:0.0:1767316885.154427:0:82406:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=c00c66f3 arg=19742a0 00000002:00010000:0.0:1767316885.154446:0:82406:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: open flags 05004040000002 00010000:00010000:0.0:1767316885.154479:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a78 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82406 initiator: MDT0 00010000:00010000:0.0:1767316885.154484:0:82406:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a78 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82406 initiator: MDT0 00000020:00100000:0.0:1767316885.154492:0:82406:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316885.154501:0:82406:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191db100 x1853163894009856/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316885.154508:0:82406:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a78 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x81000000000000 pid: 82406 initiator: MDT0 00000100:00100000:0.0:1767316885.154523:0:82406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894009856:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316885.154664:0:82406:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316885.157303:0:82406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894009856:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316885.157329:0:82406:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a78 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac312 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.157341:0:82406:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a78 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac312 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.157351:0:82406:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a78 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac312 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.157361:0:82406:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a78 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac312 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.157385:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a78 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac312 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.157392:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a78 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac312 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.157398:0:82406:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a78 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac312 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316885.157428:0:82406:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff9cfe191db100 x1853163894009856/t8589937379(8589937379) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316885.157440:0:82406:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191db100 x1853163894009856/t8589937379(8589937379) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316885.157455:0:82406:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a78 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac312 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.157468:0:82406:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 2 res 8589935621/142 (0 0) 00000080:00200000:0.0:1767316885.157474:0:82406:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1767316885.157493:0:82406:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191db100 x1853163894009856/t8589937379(8589937379) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767316885.157502:0:82406:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a78 00000080:00010000:0.0:1767316885.157508:0:82406:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a78 from it ffffa99f415fbcc0 00010000:00010000:0.0:1767316885.157511:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a78 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac312 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.157517:0:82406:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a78 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac312 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316885.157568:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:0.0:1767316885.157581:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316885.157583:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316885.157590:0:82406:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:1.0:1767316885.157692:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894009984:192.168.202.121@tcp:1:lfs.0 00000100:00100000:3.0:1767316885.159856:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316885.159958:0:42040:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767316885.159977:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939787520 00000100:00100000:2.0:1767316885.159997:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939787520 00000100:00100000:2.0:1767316885.160050:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10188 00000100:00100000:2.0:1767316885.160059:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29094450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:18361:x1853163939787520:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316885.160249:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316885.160319:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316885.160326:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29094450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:18361:x1853163939787520:12345-192.168.202.121@tcp:104: Request processed in 269us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316885.160335:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10188 00010000:00010000:0.0:1767316885.160557:0:42048:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316885.160565:0:42048:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420080000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.160584:0:42048:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037dc00 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316885.160589:0:42048:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428480000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316885.160611:0:42048:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### extent: 000000002f4477a8 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316885.160626:0:42048:0:(osc_cache.c:1103:osc_extent_make_ready()) ### extent: 000000002f4477a8 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.160677:0:42048:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000008:00100000:0.0:1767316885.160745:0:42048:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe191db800 - object 0x280000400:161 offset 0<>14 00000100:00100000:1.0:1767316885.160840:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894010112:192.168.202.121@tcp:4:bash.0 00000008:00010000:1.0:1767316885.164868:0:2503:0:(osc_cache.c:861:osc_extent_finish()) ### extent: 000000002f4477a8 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316885.164933:0:2503:0:(osc_cache.c:483:__osc_extent_remove()) ### extent: 000000002f4477a8 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316885.164962:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894010112:192.168.202.121@tcp:4:bash.0 00000080:00200000:0.0:1767316885.165002:0:42048:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767316885.165058:0:42048:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1767316885.165154:0:42048:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480000020 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.165160:0:42048:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316885.165174:0:42048:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480000020 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.165179:0:42048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56a4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480000020 nid: local remote: 0x863eb2f6655ac28d expref: -99 pid: 82258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.165215:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.165217:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.165220:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316885.165297:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894010240:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316885.167847:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894010240:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316885.169045:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894009984:192.168.202.121@tcp:1:lfs.0 00010000:00010000:0.0:1767316885.169272:0:82406:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.169298:0:82406:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:0.0:1767316885.169318:0:82406:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac304 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.169326:0:82406:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:0.0:1767316885.169515:0:82406:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.169521:0:82406:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac304 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.169525:0:82406:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316885.169527:0:82406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56a47 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac286 expref: -99 pid: 82258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.169538:0:82406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56a71 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac304 expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767316885.169552:0:82406:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316885.169559:0:82406:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191da300 x1853163894010496/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316885.169650:0:82406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894010496:192.168.202.121@tcp:36:lfs.0 00000100:00100000:1.0:1767316885.169757:0:82406:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316885.176066:0:82406:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937380 gen 1 00000100:00100000:1.0:1767316885.176139:0:82406:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe191dbb80 x1853163894009216/t8589937378(8589937378) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767316885.176154:0:82406:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe191db100 x1853163894009856/t8589937379(8589937379) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767316885.176165:0:82406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894010496:192.168.202.121@tcp:36:lfs.0 00010000:00010000:1.0:1767316885.176212:0:82406:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 31 res 8589935621/142 (0 0) 00000080:00010000:1.0:1767316885.176239:0:82406:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000002:00010000:1.0:1767316885.176252:0:82406:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: layout flags 0 00010000:00010000:1.0:1767316885.176301:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 82406 initiator: MDT0 00010000:00010000:1.0:1767316885.176311:0:82406:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82406 initiator: MDT0 00010000:00010000:1.0:1767316885.176320:0:82406:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82406 initiator: MDT0 00000100:00100000:1.0:1767316885.176340:0:82406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894010624:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316885.176857:0:82406:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316885.179541:0:82406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894010624:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316885.179579:0:82406:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.179594:0:82406:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767316885.179610:0:82406:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe18f3ce00 x1853163894010624/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/584 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316885.179620:0:82406:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767316885.179634:0:82406:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.179650:0:82406:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767316885.179656:0:82406:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316885.179689:0:82406:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a7f 00000080:00010000:1.0:1767316885.179698:0:82406:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a7f from it ffffa99f415fbc70 00010000:00010000:1.0:1767316885.179702:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.179711:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.179759:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.179771:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767316885.179779:0:82406:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8e:0x0](000000004aa96abd) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.179819:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.179824:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316885.179857:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316885.179865:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316885.179867:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316885.179871:0:82406:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316885.179921:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1767316885.179931:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.179944:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767316885.179949:0:82406:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8e:0x0](000000004aa96abd) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316885.179959:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316885.179962:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316885.179963:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316885.179965:0:82406:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316885.180004:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316885.180076:0:82406:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1767316885.180526:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.180534:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200080:1.0:1767316885.180558:0:82406:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=66f4 arg=19742a0 00000080:00200008:1.0:1767316885.180571:0:82406:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316885.180579:0:82406:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:1.0:1767316885.180600:0:82406:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316885.180608:0:82406:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 30 res 8589935621/142 (0 0) 00010000:00010000:1.0:1767316885.180650:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82406 initiator: MDT0 00010000:00010000:1.0:1767316885.180657:0:82406:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82406 initiator: MDT0 00010000:00010000:1.0:1767316885.180674:0:82406:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82406 initiator: MDT0 00000100:00100000:1.0:1767316885.180696:0:82406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894010752:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316885.180791:0:82406:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316885.186039:0:82406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894010752:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316885.186069:0:82406:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.186122:0:82406:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.186136:0:82406:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.186147:0:82406:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.186156:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.186162:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.186166:0:82406:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316885.186173:0:82406:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3ce00 x1853163894010752/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/824 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316885.186200:0:82406:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316885.186213:0:82406:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.186226:0:82406:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767316885.186234:0:82406:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316885.186291:0:82406:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1767316885.186297:0:82406:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a86 00000080:00010000:1.0:1767316885.186302:0:82406:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:1.0:1767316885.186304:0:82406:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a86 from it ffffa99f415fbcd8 00010000:00010000:1.0:1767316885.186306:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.186312:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316885.186340:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1767316885.186348:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316885.186351:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316885.186354:0:82406:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:1.0:1767316885.186377:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316885.186380:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79130, osc lock ffff9cfe09c75a20, flags 0x400000400001002 00010000:00010000:1.0:1767316885.186416:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.186421:0:82406:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.186433:0:82406:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe18f3ce00 x1853163894010880/t0(0) o101->lustre-OST0001-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1767316885.186459:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1767316885.186468:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316885.186480:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894010880:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316885.189052:0:2502:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.189116:0:2502:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.189131:0:2502:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.189143:0:2502:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316885.189157:0:2502:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 14, setting rss=14; kms=14, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316885.189168:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767316885.189255:0:2502:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.189264:0:2502:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.189285:0:2502:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.189294:0:2502:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316885.189314:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894010880:192.168.202.121@tcp:101:lfs.0 00000080:00200000:3.0:1767316885.189508:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:3.0:1767316885.189514:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:3.0:1767316885.189518:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.189522:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79130 (ffff9cfe0e4c8248/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.189527:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316885.189530:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79130 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316885.189544:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:3.0:1767316885.224502:0:82406:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=1 00000080:00200008:3.0:1767316885.224522:0:82406:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316885.224532:0:82406:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:3.0:1767316885.224559:0:82406:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316885.224578:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316885.224595:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316885.224612:0:82406:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316885.224622:0:82406:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:3.0:1767316885.224625:0:82406:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a86 00000080:00010000:3.0:1767316885.224633:0:82406:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a86 from it ffffa99f415fbcd8 00010000:00010000:3.0:1767316885.224637:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316885.224646:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316885.224672:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1767316885.224684:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767316885.224687:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767316885.224690:0:82406:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:3.0:1767316885.224709:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767316885.224713:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aa930, osc lock ffff9cfe2004fa20, flags 0x400000400001002 00010000:00010000:3.0:1767316885.224728:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.224816:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316885.224829:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767316885.224833:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.224840:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316885.224858:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316885.224868:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:3.0:1767316885.224872:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:3.0:1767316885.224875:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.224879:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aa930 (ffff9cfe0e4c8248/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.224882:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316885.224885:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aa930 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316885.224895:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767316885.224911:0:82406:0:(file.c:5185:ll_file_seek()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:3.0:1767316885.224916:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1767316885.224920:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767316885.224923:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1767316885.224927:0:82406:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767316885.224943:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000080:00200000:3.0:1767316885.224951:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316885.224956:0:82406:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 1 00000080:00200000:3.0:1767316885.224959:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767316885.224962:0:82406:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767316885.224966:0:82406:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:3.0:1767316885.224972:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:3.0:1767316885.224974:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aa930, osc lock ffff9cfe2004fa20, flags 0x0 00010000:00010000:3.0:1767316885.224995:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.225005:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.225027:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.225035:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.225042:0:82406:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000080:00200000:3.0:1767316885.225053:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000100:00100000:2.0:1767316885.225200:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894011008:192.168.202.121@tcp:23:lfs.0 00000100:00100000:2.0:1767316885.230577:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894011008:192.168.202.121@tcp:23:lfs.0 00000020:00010000:3.0:1767316885.230619:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:3.0:1767316885.230625:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.230631:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aa930 (ffff9cfe0e4c8248/1) at cl_lock_cancel():142 00010000:00010000:3.0:1767316885.230643:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.230657:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00010000:3.0:1767316885.230671:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316885.230673:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aa930 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316885.230690:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767316885.230698:0:82406:0:(file.c:5216:ll_file_seek()) COMPLETED file f212a.sanity-flr:[0x200000405:0x8e:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:3.0:1767316885.230709:0:82406:0:(file.c:5185:ll_file_seek()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:3.0:1767316885.230716:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1767316885.230748:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767316885.230750:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1767316885.230754:0:82406:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767316885.230775:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000080:00200000:3.0:1767316885.230779:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316885.230783:0:82406:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 1 00000080:00200000:3.0:1767316885.230785:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767316885.230788:0:82406:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767316885.230790:0:82406:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:3.0:1767316885.230800:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:3.0:1767316885.230803:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aa930, osc lock ffff9cfe2004fa20, flags 0x0 00010000:00010000:3.0:1767316885.230822:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.230831:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.230840:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.230845:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.230850:0:82406:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000080:00200000:3.0:1767316885.230856:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000100:00100000:2.0:1767316885.231008:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894011136:192.168.202.121@tcp:23:lfs.0 00000100:00100000:2.0:1767316885.237136:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894011136:192.168.202.121@tcp:23:lfs.0 00000020:00010000:3.0:1767316885.237297:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:3.0:1767316885.237302:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.237322:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aa930 (ffff9cfe0e4c8248/1) at cl_lock_cancel():142 00010000:00010000:3.0:1767316885.237333:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.237346:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00010000:3.0:1767316885.237361:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316885.237364:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aa930 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316885.237380:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767316885.237391:0:82406:0:(file.c:5216:ll_file_seek()) COMPLETED file f212a.sanity-flr:[0x200000405:0x8e:0x0], offset: 0, type: SEEK_HOLE, rc = 14 00000080:00200080:3.0:1767316885.237405:0:82406:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=0 00000080:00200080:3.0:1767316885.237414:0:82406:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=1 00000080:00200008:3.0:1767316885.237420:0:82406:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316885.237428:0:82406:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:3.0:1767316885.237448:0:82406:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316885.237464:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316885.237476:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316885.237483:0:82406:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316885.237490:0:82406:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:3.0:1767316885.237493:0:82406:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a86 00000080:00010000:3.0:1767316885.237499:0:82406:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a86 from it ffffa99f415fbcd8 00010000:00010000:3.0:1767316885.237502:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316885.237516:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316885.237537:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1767316885.237548:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767316885.237551:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767316885.237555:0:82406:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:3.0:1767316885.237570:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767316885.237574:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aa930, osc lock ffff9cfe2004fa20, flags 0x400000400001002 00010000:00010000:3.0:1767316885.237588:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.237597:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316885.237609:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767316885.237612:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.237618:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316885.237627:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316885.237637:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:3.0:1767316885.237639:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:3.0:1767316885.237642:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.237645:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aa930 (ffff9cfe0e4c8248/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.237653:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316885.237656:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aa930 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316885.237663:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767316885.237687:0:82406:0:(file.c:2474:do_file_read_iter()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], ppos: 0, count: 4096 00000080:00200000:3.0:1767316885.237693:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1767316885.237696:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767316885.237699:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1767316885.237702:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316885.237706:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1767316885.237710:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767316885.237712:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767316885.237714:0:82406:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:3.0:1767316885.237721:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767316885.237723:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aa930, osc lock ffff9cfe2004fa20, flags 0x400000400001002 00010000:00010000:3.0:1767316885.237966:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.237978:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316885.237997:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767316885.238000:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.238008:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316885.238017:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316885.238030:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:3.0:1767316885.238032:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d17230 (ffff9cfe0e4c8248/0) at cl_lock_release():245 00000020:00010000:3.0:1767316885.238035:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d17230 (ffff9cfe0e4c8248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.238038:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aa930 (ffff9cfe0e4c8128/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.238041:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d17230 (ffff9cfe0e4c8248/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316885.238043:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aa930 (ffff9cfe0e4c8248/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316885.238048:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316885.238053:0:82406:0:(file.c:2367:file_read_confine_iter()) f212a.sanity-flr: read [0, 4096] over eof, kms 14, file_size 14. 00000080:00200000:3.0:1767316885.238061:0:82406:0:(file.c:1994:ll_file_io_generic()) f212a.sanity-flr: read ppos: 0, bytes: 14 00000080:00200000:3.0:1767316885.238070:0:82406:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 1 00000020:00200000:3.0:1767316885.238077:0:82406:0:(cl_io.c:214:cl_io_rw_init()) header@00000000698bd428[0x4, 2, [0x200000405:0x8e:0x0] hash] 00000020:00200000:3.0:1767316885.238281:0:82406:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 14) 2048 0 00000080:00200000:3.0:1767316885.238285:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00000080:00200000:3.0:1767316885.238295:0:82406:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767316885.238301:0:82406:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 14) 14, 14 00020000:00200000:3.0:1767316885.238305:0:82406:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767316885.238317:0:82406:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:3.0:1767316885.238326:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767316885.238329:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aa930, osc lock ffff9cfe2004fa20, flags 0x40000 00000080:00200000:3.0:1767316885.238335:0:82406:0:(vvp_io.c:827:vvp_io_read_start()) f212a.sanity-flr: read [0, 14) 00000080:00200000:3.0:1767316885.238345:0:82406:0:(vvp_io.c:886:vvp_io_read_start()) count:14 iocb pos:0 00000080:00200000:3.0:1767316885.238942:0:82406:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), size=14 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:3.0:1767316885.239019:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767316885.239022:0:82406:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 14 count 14 file_offset 14 00000020:00010000:3.0:1767316885.239030:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:3.0:1767316885.239033:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.239036:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aa930 (ffff9cfe0e4c8248/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.239038:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316885.239040:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aa930 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316885.239047:0:82406:0:(vvp_io.c:518:vvp_io_advance()) advancing 14 bytes 00000020:00200000:3.0:1767316885.239060:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767316885.239155:0:60911:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe02e89000 00000008:00100000:3.0:1767316885.239198:0:60911:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe18fd4a80 - object 0x280000400:161 offset 0<>14 00000100:00100000:2.0:1767316885.239274:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894011264:192.168.202.121@tcp:3:lfs.0 00000008:00010000:2.0:1767316885.244490:0:2505:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe02e89000 00000020:00200000:2.0:1767316885.244503:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767316885.244511:0:2505:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 14 00000020:00200000:2.0:1767316885.244520:0:2505:0:(cl_io.c:1643:__ll_dio_user_copy()) count 14, offset 0, pos 0, cdp_page_count 1 00000020:00200000:2.0:1767316885.244534:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767316885.244614:0:2505:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe02e89000 00000100:00100000:2.0:1767316885.244641:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894011264:192.168.202.121@tcp:3:lfs.0 00000080:00200000:3.0:1767316885.244711:0:82406:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1767316885.244723:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316885.244728:0:82406:0:(file.c:2142:ll_file_io_generic()) f212a.sanity-flr: 1 io complete with rc: 0, result: 14, restart: 0 00000020:00200000:3.0:1767316885.244730:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316885.244738:0:82406:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 14 00000080:00200080:3.0:1767316885.244755:0:82406:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=0 00000080:00200080:3.0:1767316885.244765:0:82406:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=2 00000080:00200008:3.0:1767316885.244773:0:82406:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316885.244780:0:82406:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:3.0:1767316885.244802:0:82406:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316885.244832:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316885.244846:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316885.244854:0:82406:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316885.244861:0:82406:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:3.0:1767316885.244865:0:82406:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a86 00000080:00010000:3.0:1767316885.244872:0:82406:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a86 from it ffffa99f415fbcd8 00010000:00010000:3.0:1767316885.244876:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316885.244897:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316885.244922:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1767316885.244948:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767316885.244951:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767316885.244954:0:82406:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:3.0:1767316885.244970:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767316885.244973:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aa930, osc lock ffff9cfe2004fa20, flags 0x400000400001002 00010000:00010000:3.0:1767316885.245002:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.245013:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316885.245023:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767316885.245027:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.245034:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316885.245043:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316885.245052:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:3.0:1767316885.245056:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:3.0:1767316885.245059:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.245062:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aa930 (ffff9cfe0e4c8248/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.245077:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316885.245503:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aa930 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316885.245513:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767316885.245537:0:82406:0:(file.c:2648:do_file_write_iter()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], ppos: 0, count: 4096 00000080:00200000:3.0:1767316885.245544:0:82406:0:(file.c:1994:ll_file_io_generic()) f212a.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:3.0:1767316885.245558:0:82406:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 2 00000020:00200000:3.0:1767316885.245564:0:82406:0:(cl_io.c:214:cl_io_rw_init()) header@00000000698bd428[0x4, 2, [0x200000405:0x8e:0x0] hash] 00000020:00200000:3.0:1767316885.245566:0:82406:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:3.0:1767316885.245569:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00000080:00200000:3.0:1767316885.245580:0:82406:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767316885.245586:0:82406:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:3.0:1767316885.245590:0:82406:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:3.0:1767316885.245602:0:82406:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1767316885.245610:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767316885.245613:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aa930, osc lock ffff9cfe2004fa20, flags 0x40000 00000080:00200000:3.0:1767316885.245621:0:82406:0:(vvp_io.c:1312:vvp_io_write_start()) f212a.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000080:00200000:3.0:1767316885.245646:0:82406:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:3.0:1767316885.245701:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767316885.245703:0:82406:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:3.0:1767316885.245713:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:3.0:1767316885.245716:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:3.0:1767316885.245719:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.245721:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aa930 (ffff9cfe0e4c8248/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.245723:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316885.245726:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aa930 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316885.245732:0:82406:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:3.0:1767316885.245737:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767316885.245756:0:60911:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe02e89cc0 00000008:00100000:3.0:1767316885.245833:0:60911:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe18fd7100 - object 0x2c0000400:160 offset 0<>4096 00000100:00100000:2.0:1767316885.245920:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894011392:192.168.202.121@tcp:4:lfs.0 00000100:00100000:2.0:1767316885.254940:0:2504:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff9cfe08c17800: committing for last_committed 25769805124 gen 1 00000008:00010000:2.0:1767316885.255004:0:2504:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe02e89cc0 00000020:00200000:2.0:1767316885.255011:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767316885.255019:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767316885.255033:0:2504:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe02e89cc0 00000100:00100000:2.0:1767316885.255057:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894011392:192.168.202.121@tcp:4:lfs.0 00000080:00200000:3.0:1767316885.255822:0:82406:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1767316885.255835:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316885.255839:0:82406:0:(file.c:2142:ll_file_io_generic()) f212a.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:3.0:1767316885.255848:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00200000:3.0:1767316885.255851:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316885.255859:0:82406:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:3.0:1767316885.255877:0:82406:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=0 00000080:00200080:3.0:1767316885.255909:0:82406:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=1 00000080:00200008:3.0:1767316885.255915:0:82406:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316885.255920:0:82406:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:3.0:1767316885.255936:0:82406:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316885.255952:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316885.255964:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316885.255970:0:82406:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316885.255976:0:82406:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:3.0:1767316885.255979:0:82406:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a86 00000080:00010000:3.0:1767316885.255995:0:82406:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a86 from it ffffa99f415fbcd8 00010000:00010000:3.0:1767316885.255999:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316885.256008:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316885.256031:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1767316885.256040:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767316885.256043:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767316885.256046:0:82406:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:3.0:1767316885.256074:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767316885.256100:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aa930, osc lock ffff9cfe2004fa20, flags 0x400000400001002 00010000:00010000:3.0:1767316885.256118:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.256140:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316885.256152:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767316885.256156:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.256164:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316885.256174:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316885.256191:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:3.0:1767316885.256196:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:3.0:1767316885.256199:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.256202:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aa930 (ffff9cfe0e4c8248/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.256206:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316885.256208:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aa930 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316885.256216:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767316885.256226:0:82406:0:(file.c:5185:ll_file_seek()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], offset: 14, type: SEEK_DATA 00000080:00200000:3.0:1767316885.256232:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1767316885.256236:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767316885.256238:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1767316885.256243:0:82406:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767316885.256258:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000080:00200000:3.0:1767316885.256264:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316885.256268:0:82406:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 1 00000080:00200000:3.0:1767316885.256277:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767316885.256281:0:82406:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767316885.256286:0:82406:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:3.0:1767316885.256292:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:3.0:1767316885.256294:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aa930, osc lock ffff9cfe2004fa20, flags 0x0 00010000:00010000:3.0:1767316885.256302:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.256310:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.256318:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.256325:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.256330:0:82406:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000080:00200000:3.0:1767316885.256341:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:3.0:1767316885.256345:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:3.0:1767316885.256347:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.256349:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aa930 (ffff9cfe0e4c8248/1) at cl_lock_cancel():142 00010000:00010000:3.0:1767316885.256352:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.256358:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00010000:3.0:1767316885.256800:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316885.256802:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aa930 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316885.256812:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767316885.256819:0:82406:0:(file.c:5185:ll_file_seek()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], offset: 0, type: (null) 00000080:00200000:3.0:1767316885.256824:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1767316885.256830:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767316885.256832:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767316885.256834:0:82406:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:3.0:1767316885.256842:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767316885.256844:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aa930, osc lock ffff9cfe2004fa20, flags 0x400000400001002 00010000:00010000:3.0:1767316885.256851:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.256861:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316885.256868:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767316885.256871:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.256878:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316885.256950:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316885.256957:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:3.0:1767316885.256960:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:3.0:1767316885.256969:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.256972:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aa930 (ffff9cfe0e4c8248/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316885.256975:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316885.256978:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aa930 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316885.256994:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767316885.257001:0:82406:0:(file.c:5216:ll_file_seek()) COMPLETED file f212a.sanity-flr:[0x200000405:0x8e:0x0], offset: 0, type: (null), rc = 14 00000080:00200080:3.0:1767316885.257009:0:82406:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=0 00000080:00200080:2.0:1767316885.267461:0:82406:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=2 00000080:00200008:2.0:1767316885.267482:0:82406:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316885.267491:0:82406:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:2.0:1767316885.267517:0:82406:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316885.267534:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316885.267550:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316885.267575:0:82406:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316885.267583:0:82406:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:2.0:1767316885.267587:0:82406:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56a86 00000080:00010000:2.0:1767316885.267595:0:82406:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a86 from it ffffa99f415fbcd8 00010000:00010000:2.0:1767316885.267599:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316885.267608:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316885.267637:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1767316885.267650:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316885.267654:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767316885.267658:0:82406:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:2.0:1767316885.267679:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316885.267682:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f7b0, osc lock ffff9cfe2013da20, flags 0x400000400001002 00010000:00010000:2.0:1767316885.267698:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316885.267709:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316885.267721:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316885.267724:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316885.267732:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316885.267749:0:82406:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316885.267759:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:2.0:1767316885.267763:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d176c0 (ffff9cfe0e4c8b48/0) at cl_lock_release():245 00000020:00010000:2.0:1767316885.267766:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d176c0 (ffff9cfe0e4c8b48/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316885.267770:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f7b0 (ffff9cfe0e4c87e8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316885.267773:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d176c0 (ffff9cfe0e4c8b48/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316885.267776:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f7b0 (ffff9cfe0e4c8b48/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316885.267788:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767316885.267816:0:82406:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) current size 14, valid attrs 2068, mode 0, uid -1941070030, gid -1, new size 14, atime 1767316885.000000000, mtime 1767316885.000000000, ctime 1767316885.000000000 00010000:00010000:2.0:1767316885.267840:0:82406:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316885.267858:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316885.268006:0:82406:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316885.268014:0:82406:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767316885.268017:0:82406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56a86 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac33c expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000020:00100000:2.0:1767316885.268040:0:82406:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767316885.268053:0:82406:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29109880 x1853163894011648/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767316885.268603:0:82406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894011648:192.168.202.121@tcp:36:lfs.0 00000100:00100000:2.0:1767316885.268715:0:82406:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe09f07b40 going to sleep for 11 seconds 00000100:00100000:2.0:1767316885.274843:0:82406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894011648:192.168.202.121@tcp:36:lfs.0 00000080:00200000:2.0:1767316885.274971:0:82406:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 2 00000080:00200000:2.0:1767316885.274978:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1767316885.275012:0:82406:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:2.0:1767316885.275027:0:82406:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1767316885.275043:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1767316885.275047:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f7b0, osc lock ffff9cfe2013da20, flags 0x0 00010000:00010000:2.0:1767316885.275468:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316885.275481:0:82406:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316885.275493:0:82406:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767316885.275517:0:82406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910aa00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894011776:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316885.276348:0:82406:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe09f07b40 going to sleep for 11 seconds 00000100:00100000:2.0:1767316885.279794:0:82406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910aa00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894011776:192.168.202.121@tcp:101:lfs.0 00010000:00010000:2.0:1767316885.279825:0:82406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316885.279840:0:82406:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316885.279855:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767316885.279881:0:82406:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 4/0,2 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316885.279904:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316885.279912:0:82406:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767316885.280011:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767316885.280030:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894011904:192.168.202.121@tcp:10:lfs.0 00000100:00100000:2.0:1767316885.284192:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894011904:192.168.202.121@tcp:10:lfs.0 00000080:00200000:1.0:1767316885.284344:0:82406:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:1.0:1767316885.284352:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284998 (ffff9cfe0e4c8b48/0) at cl_lock_release():245 00000020:00010000:1.0:1767316885.284356:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284998 (ffff9cfe0e4c8b48/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316885.284361:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f7b0 (ffff9cfe0e4c87e8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767316885.284383:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.284396:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767316885.284414:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284998 (ffff9cfe0e4c8b48/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316885.284417:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f7b0 (ffff9cfe0e4c8b48/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316885.284436:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316885.284448:0:82406:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) current size 14, valid attrs 2168, mode 0, uid -1941070030, gid -1, new size 14, atime 1767316885.000000000, mtime 1767316885.000000000, ctime 1767316885.000000000, rc 0 00000080:00200080:1.0:1767316885.284468:0:82406:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=0 00000080:00200008:1.0:1767316885.284495:0:82406:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) current size 14, valid attrs 101f0, mode a99f, uid 35990696, gid -25346, new size 18446635213717717704, atime 1767316884.000000000, mtime 1767316885.000000000, ctime 1767316885.000000000 00000020:00100000:1.0:1767316885.284571:0:82406:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316885.284579:0:82406:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3ce00 x1853163894012160/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316885.284602:0:82406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894012160:192.168.202.121@tcp:36:lfs.0 00000100:00100000:1.0:1767316885.284681:0:82406:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316885.288803:0:82406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894012160:192.168.202.121@tcp:36:lfs.0 00000080:00200000:1.0:1767316885.288852:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:1.0:1767316885.288865:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316885.288869:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316885.288877:0:82406:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316885.288903:0:82406:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1767316885.288945:0:82406:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767316885.288950:0:82406:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d794b0, osc lock ffff9cfe09c74130, flags 0x0 00010000:00010000:1.0:1767316885.288966:0:82406:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe04b80000 type 11 mode 2 res 10737419264/161 (0 18446744073709551615) 00010000:00010000:1.0:1767316885.289022:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.289033:0:82406:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.289042:0:82406:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316885.289062:0:82406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894012288:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316885.289191:0:82406:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1767316885.296343:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316885.297349:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939787904 00000100:00100000:2.0:1767316885.297360:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939787904 00000100:00100000:2.0:1767316885.297491:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10189 00000100:00100000:2.0:1767316885.297501:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:18361:x1853163939787904:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316885.297519:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316885.297603:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316885.297610:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:18361:x1853163939787904:12345-192.168.202.121@tcp:104: Request processed in 111us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316885.297618:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10189 00010000:00010000:1.0:1767316885.298029:0:63840:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316885.298053:0:63840:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.298071:0:63840:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d800 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:1.0:1767316885.298077:0:63840:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316885.298120:0:63840:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767316885.298134:0:63840:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1767316885.298182:0:63840:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.298190:0:63840:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316885.298223:0:63840:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.298230:0:63840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56a8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac343 expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.298247:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316885.298249:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316885.298251:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316885.298331:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894012416:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316885.304312:0:82406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894012288:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316885.304345:0:82406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.304359:0:82406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.304394:0:82406:0:(ldlm_request.c:303:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767316885.306565:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316885.306791:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939788032 00000100:00100000:3.0:1767316885.306802:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939788032 00000100:00100000:3.0:1767316885.306877:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10190 00000100:00100000:3.0:1767316885.306887:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:19746:x1853163939788032:12345-192.168.202.121@tcp:105: 00010000:00010000:3.0:1767316885.306902:0:42040:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 5/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.306913:0:42040:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 5/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.306921:0:42040:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 5/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.306933:0:42040:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.306942:0:42040:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.306965:0:42040:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.307009:0:42040:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9cfe03c2d000) 00000100:00100000:3.0:1767316885.307073:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:19746:x1853163939788032:12345-192.168.202.121@tcp:105: Request processed in 187us (520us total) trans 0 rc 0/0 00010000:00010000:1.0:1767316885.307226:0:82406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.307236:0:82406:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.307251:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316885.307263:0:82406:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 14, setting rss=14; kms=14, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.307275:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.307284:0:82406:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316885.307507:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894012544:192.168.202.121@tcp:2:lfs.0 00000100:00100000:3.0:1767316885.307818:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10190 00000100:00100000:0.0:1767316885.310827:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894012544:192.168.202.121@tcp:2:lfs.0 00000020:00010000:1.0:1767316885.310971:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284998 (ffff9cfe0e4c8b48/0) at cl_lock_release():245 00000020:00010000:1.0:1767316885.310977:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284998 (ffff9cfe0e4c8b48/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316885.310993:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d794b0 (ffff9cfe0e4c87e8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767316885.311006:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.311029:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767316885.311046:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284998 (ffff9cfe0e4c8b48/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316885.311049:0:82406:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d794b0 (ffff9cfe0e4c8b48/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316885.311067:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316885.311246:0:82406:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) current size 14, valid attrs 101f0, mode a99f, uid 35990696, gid -25346, new size 18446635213717717704, atime 1767316884.000000000, mtime 1767316885.000000000, ctime 1767316885.000000000, rc 0 00000080:00200080:1.0:1767316885.311273:0:82406:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=c00c66f3 arg=19742a0 00010000:00010000:1.0:1767316885.311328:0:82406:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a78 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x863eb2f6655ac312 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.311346:0:82406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56a78 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x863eb2f6655ac312 expref: -99 pid: 82406 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316885.311448:0:82406:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191db100 x1853163894009856/t8589937379(8589937379) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316885.311461:0:82406:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316885.311468:0:82406:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3e680 x1853163894012800/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316885.311490:0:82406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894012800:192.168.202.121@tcp:35:lfs.0 00000100:00100000:1.0:1767316885.311583:0:82406:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316885.315683:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316885.315725:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939788160 00000100:00100000:2.0:1767316885.315746:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939788160 00000100:00100000:2.0:1767316885.315794:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10191 00000100:00100000:2.0:1767316885.315805:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15471:x1853163939788160:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316885.315822:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316885.315900:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316885.315907:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15471:x1853163939788160:12345-192.168.202.121@tcp:104: Request processed in 104us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316885.315914:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10191 00010000:00010000:0.0:1767316885.316129:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316885.316137:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.316145:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316885.316150:0:63142:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.316158:0:63142:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.316166:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.316191:0:63142:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:0.0:1767316885.316235:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.316241:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316885.316268:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.316276:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56a7f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac32e expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.316291:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.316304:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.316306:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316885.316314:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316885.316328:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894012928:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316885.320051:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894012416:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316885.324134:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894012928:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316885.330820:0:82406:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937384 gen 1 00000100:00100000:1.0:1767316885.330866:0:82406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894012800:192.168.202.121@tcp:35:lfs.0 00000002:00100000:1.0:1767316885.330898:0:82406:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191db100 x1853163894009856/t8589937379(8589937379) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767316885.330932:0:82406:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 31 res 8589935621/142 (0 0) 00000080:00010000:1.0:1767316885.330943:0:82406:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000002:00010000:1.0:1767316885.330953:0:82406:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: layout flags 0 00010000:00010000:1.0:1767316885.331012:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82406 initiator: MDT0 00010000:00010000:1.0:1767316885.331021:0:82406:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82406 initiator: MDT0 00010000:00010000:1.0:1767316885.331029:0:82406:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82406 initiator: MDT0 00000100:00100000:1.0:1767316885.331050:0:82406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894013056:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316885.331582:0:82406:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316885.336537:0:82406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894013056:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316885.336567:0:82406:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.336582:0:82406:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767316885.336595:0:82406:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe18f3e680 x1853163894013056/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/584 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316885.336606:0:82406:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767316885.336637:0:82406:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.336651:0:82406:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767316885.336657:0:82406:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316885.336674:0:82406:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56aa2 00000080:00010000:1.0:1767316885.336682:0:82406:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56aa2 from it ffffa99f415fbbc8 00010000:00010000:1.0:1767316885.336686:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.336695:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.336718:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.336729:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767316885.336815:0:82406:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8e:0x0](000000004aa96abd) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.336854:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.336860:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316885.336884:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767316885.336894:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316885.336897:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316885.336902:0:82406:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316885.336928:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1767316885.336941:0:82406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.336949:0:82406:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767316885.336956:0:82406:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x8e:0x0](000000004aa96abd) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316885.336974:0:82406:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316885.336979:0:82406:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316885.336993:0:82406:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316885.336995:0:82406:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316885.337003:0:82406:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:1.0:1767316885.337017:0:82406:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 14 blocks 8 [cma]time: 1767316885 1767316885 0 by oinfo size 14 blocks 8 [cma]time 1767316885 1767316885 1767316884 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 1/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316885.337043:0:82406:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1767316885 1767316885 0 by oinfo size 14 blocks 8 [cma]time 1767316885 1767316885 0 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 1/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316885.337495:0:82406:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4294967294 -> 5 00010000:00010000:1.0:1767316885.337510:0:82406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.337518:0:82406:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767316885.337554:0:82406:0:(file.c:424:ll_file_release()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), flags 154002 00000002:00100000:1.0:1767316885.337603:0:82406:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191dbb80 x1853163894009216/t8589937378(8589937378) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316885.337615:0:82406:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316885.337622:0:82406:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3e680 x1853163894013312/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316885.337646:0:82406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894013312:192.168.202.121@tcp:35:lfs.0 00000100:00100000:1.0:1767316885.337747:0:82406:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316885.340772:0:82406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82406:1853163894013312:192.168.202.121@tcp:35:lfs.0 00000002:00100000:1.0:1767316885.340807:0:82406:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191dbb80 x1853163894009216/t8589937378(8589937378) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316885.369215:0:82408:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316885.369245:0:82408:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316885.369264:0:82408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.369279:0:82408:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316885.369287:0:82408:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316885.369294:0:82408:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316885.369297:0:82408:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:0.0:1767316885.369304:0:82408:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f41dabbf8 00010000:00010000:0.0:1767316885.369309:0:82408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.369316:0:82408:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316885.369332:0:82408:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316885.369344:0:82408:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), file ffff9cfe09be6d80, open_flags 18800, mode 0 opened 0 00000080:00200000:0.0:1767316885.369350:0:82408:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open 00000002:00010000:0.0:1767316885.369364:0:82408:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0304001 00010000:00010000:0.0:1767316885.369417:0:82408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82408 initiator: MDT0 00010000:00010000:0.0:1767316885.369430:0:82408:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82408 initiator: MDT0 00000020:00100000:0.0:1767316885.369444:0:82408:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316885.369456:0:82408:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8a80 x1853163894013568/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316885.369466:0:82408:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82408 initiator: MDT0 00000100:00100000:0.0:1767316885.369487:0:82408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82408:1853163894013568:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316885.374916:0:82408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316885.378351:0:82408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82408:1853163894013568:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316885.378378:0:82408:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aa9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82408 initiator: MDT0 00010000:00010000:0.0:1767316885.378392:0:82408:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aa9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82408 initiator: MDT0 00010000:00010000:0.0:1767316885.378399:0:82408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aa9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82408 initiator: MDT0 00010000:00010000:0.0:1767316885.378407:0:82408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aa9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82408 initiator: MDT0 00010000:00010000:0.0:1767316885.378413:0:82408:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aa9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82408 initiator: MDT0 00010000:00010000:0.0:1767316885.378420:0:82408:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037d600 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316885.378424:0:82408:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aa9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82408 initiator: MDT0 00010000:00010000:0.0:1767316885.378443:0:82408:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aa9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82408 initiator: MDT0 00010000:00010000:0.0:1767316885.378450:0:82408:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aa9 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 82408 initiator: MDT0 00010000:00010000:0.0:1767316885.378457:0:82408:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316885.378463:0:82408:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aa9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82408 initiator: MDT0 00010000:00010000:0.0:1767316885.378469:0:82408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82408 initiator: MDT0 00000002:00100000:0.0:1767316885.378489:0:82408:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=-20 req@ffff9cfe191d8a80 x1853163894013568/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/608 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316885.378504:0:82408:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc -20 00000080:00200000:0.0:1767316885.378628:0:82408:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316885.378648:0:82408:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316885.378662:0:82408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.378674:0:82408:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316885.378680:0:82408:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316885.378685:0:82408:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316885.378689:0:82408:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:0.0:1767316885.378693:0:82408:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f41dabbb0 00010000:00010000:0.0:1767316885.378696:0:82408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.378717:0:82408:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316885.378812:0:82408:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 44 00000080:00200008:0.0:1767316885.378823:0:82408:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags 304000 00000080:00200080:0.0:1767316885.378857:0:82408:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148) cmd=c0086915 arg=16cc3d0 00000100:00100000:0.0:1767316885.378915:0:82408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82408:1853163894013696:192.168.202.121@tcp:34:lfs.0 00000100:00100000:0.0:1767316885.379579:0:82408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316885.382910:0:82408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82408:1853163894013696:192.168.202.121@tcp:34:lfs.0 00000080:00200008:0.0:1767316885.385894:0:82408:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags 304000 00000080:00200000:1.0:1767316885.400026:0:82410:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316885.400058:0:82410:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316885.400320:0:82410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.400338:0:82410:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316885.400346:0:82410:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316885.400355:0:82410:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316885.400365:0:82410:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:1.0:1767316885.400373:0:82410:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f40c8fb58 00010000:00010000:1.0:1767316885.400377:0:82410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.400386:0:82410:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316885.400402:0:82410:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316885.400417:0:82410:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=9 00000080:00200000:1.0:1767316885.400421:0:82410:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316885.400435:0:82410:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316885.400483:0:82410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82410 initiator: MDT0 00010000:00010000:1.0:1767316885.400491:0:82410:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82410 initiator: MDT0 00010000:00010000:1.0:1767316885.400501:0:82410:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82410 initiator: MDT0 00000100:00100000:1.0:1767316885.400528:0:82410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82410:1853163894013824:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316885.400674:0:82410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316885.404971:0:82410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82410:1853163894013824:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316885.405007:0:82410:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.405024:0:82410:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.405048:0:82410:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.405276:0:82410:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.405289:0:82410:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.405302:0:82410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.405309:0:82410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.405316:0:82410:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316885.405326:0:82410:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3e680 x1853163894013824/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/824 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316885.405336:0:82410:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316885.405349:0:82410:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.405360:0:82410:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767316885.405366:0:82410:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316885.405416:0:82410:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 14 00000080:00200000:1.0:1767316885.405419:0:82410:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8e:0x0](ffff9cfe0edb42c8): rc = 0 00000080:00200000:1.0:1767316885.405433:0:82410:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 5 -> 5 00000080:00010000:1.0:1767316885.405439:0:82410:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56ab0 00000080:00010000:1.0:1767316885.405449:0:82410:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:1.0:1767316885.405453:0:82410:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ab0 from it ffffa99f40c8fb20 00010000:00010000:1.0:1767316885.405456:0:82410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.405465:0:82410:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767316885.405501:0:82410:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316885.405508:0:82410:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:1.0:1767316885.405529:0:82410:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316885.405537:0:82410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.405547:0:82410:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316885.405553:0:82410:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316885.405557:0:82410:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:1.0:1767316885.405560:0:82410:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56ab0 00000080:00010000:1.0:1767316885.405564:0:82410:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ab0 from it ffffa99f40c8fcb8 00010000:00010000:1.0:1767316885.405566:0:82410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.405573:0:82410:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316885.405623:0:82410:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316885.405631:0:82410:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316885.405638:0:82410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.405645:0:82410:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316885.405651:0:82410:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316885.405654:0:82410:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316885.405656:0:82410:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:1.0:1767316885.405660:0:82410:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f40c8fbf8 00010000:00010000:1.0:1767316885.405662:0:82410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.405669:0:82410:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316885.405676:0:82410:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316885.405682:0:82410:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=265 00000080:00200000:1.0:1767316885.405687:0:82410:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), inode mode 81a4 mask 44 00000080:00200008:1.0:1767316885.405694:0:82410:0:(file.c:1001:ll_file_open()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), flags 154400 00000002:00010000:1.0:1767316885.405708:0:82410:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114401 00010000:00010000:1.0:1767316885.405821:0:82410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82410 initiator: MDT0 00010000:00010000:1.0:1767316885.405829:0:82410:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82410 initiator: MDT0 00000020:00100000:1.0:1767316885.405849:0:82410:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316885.405855:0:82410:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3e680 x1853163894014080/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316885.405863:0:82410:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82410 initiator: MDT0 00000100:00100000:1.0:1767316885.405881:0:82410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82410:1853163894014080:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316885.406333:0:82410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316885.410015:0:82410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82410:1853163894014080:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316885.410047:0:82410:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.410057:0:82410:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.410068:0:82410:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.410077:0:82410:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316885.410113:0:82410:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe18f3e680 x1853163894014080/t8589937386(8589937386) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316885.410126:0:82410:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3e680 x1853163894014080/t8589937386(8589937386) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316885.410138:0:82410:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316885.410176:0:82410:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.410199:0:82410:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767316885.410205:0:82410:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316885.410247:0:82410:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 14 00000080:00200000:1.0:1767316885.410262:0:82410:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 5 -> 5 00000080:00010000:1.0:1767316885.410266:0:82410:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56ab7 00000080:00010000:1.0:1767316885.410272:0:82410:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ab7 from it ffffa99f40c8fbf0 00010000:00010000:1.0:1767316885.410276:0:82410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.410285:0:82410:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767316885.410313:0:82410:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3e680 x1853163894014080/t8589937386(8589937386) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:1.0:1767316885.410411:0:82410:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=c00c66f3 arg=7fff79bebcf4 00000002:00010000:1.0:1767316885.410431:0:82410:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: open flags 01004040000001 00010000:00010000:1.0:1767316885.410477:0:82410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 82410 initiator: MDT0 00010000:00010000:1.0:1767316885.410484:0:82410:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82410 initiator: MDT0 00000020:00100000:1.0:1767316885.410495:0:82410:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316885.410501:0:82410:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3ce00 x1853163894014336/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316885.410516:0:82410:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x81000000000000 pid: 82410 initiator: MDT0 00000100:00100000:1.0:1767316885.410533:0:82410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82410:1853163894014336:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316885.410932:0:82410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316885.414029:0:82410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82410:1853163894014336:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316885.414054:0:82410:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac3e4 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.414346:0:82410:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 4/1,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac3e4 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.414358:0:82410:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac3e4 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.414369:0:82410:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac3e4 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.414383:0:82410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac3e4 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.414390:0:82410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac3e4 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.414397:0:82410:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac3e4 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316885.414409:0:82410:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff9cfe18f3ce00 x1853163894014336/t8589937387(8589937387) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316885.414436:0:82410:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3ce00 x1853163894014336/t8589937387(8589937387) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316885.414453:0:82410:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac3e4 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.414467:0:82410:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 2 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767316885.414473:0:82410:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1767316885.414492:0:82410:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3ce00 x1853163894014336/t8589937387(8589937387) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767316885.414500:0:82410:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56abe 00000080:00010000:1.0:1767316885.414507:0:82410:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56abe from it ffffa99f40c8fcc0 00010000:00010000:1.0:1767316885.414510:0:82410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac3e4 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.414517:0:82410:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac3e4 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316885.414718:0:82410:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1767316885.414728:0:82410:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), xattr lov 00000080:00200008:1.0:1767316885.414771:0:82410:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316885.414779:0:82410:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:1.0:1767316885.414801:0:82410:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316885.414810:0:82410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.414820:0:82410:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316885.414833:0:82410:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316885.414839:0:82410:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:1.0:1767316885.414843:0:82410:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56ab0 00000080:00010000:1.0:1767316885.414847:0:82410:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ab0 from it ffffa99f40c8fcd8 00010000:00010000:1.0:1767316885.414851:0:82410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.414859:0:82410:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000080:00200080:1.0:1767316885.414912:0:82410:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=66f4 arg=1 00000080:00200080:0.0:1767316885.450304:0:82410:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=1 00000080:00200008:0.0:1767316885.450323:0:82410:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316885.450331:0:82410:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:0.0:1767316885.450360:0:82410:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316885.450378:0:82410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.450392:0:82410:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.450401:0:82410:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316885.450411:0:82410:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:0.0:1767316885.450415:0:82410:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56ab0 00000080:00010000:0.0:1767316885.450423:0:82410:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ab0 from it ffffa99f40c8fcd8 00010000:00010000:0.0:1767316885.450427:0:82410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.450442:0:82410:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316885.450480:0:82410:0:(file.c:2474:do_file_read_iter()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], ppos: 0, count: 14 00000080:00200000:0.0:1767316885.450492:0:82410:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:0.0:1767316885.450506:0:82410:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316885.450509:0:82410:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:0.0:1767316885.450525:0:82410:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316885.450535:0:82410:0:(file.c:1994:ll_file_io_generic()) f212a.sanity-flr: read ppos: 0, bytes: 14 00000080:00200000:0.0:1767316885.450545:0:82410:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 1 00000020:00200000:0.0:1767316885.450553:0:82410:0:(cl_io.c:214:cl_io_rw_init()) header@00000000698bd428[0x4, 2, [0x200000405:0x8e:0x0] hash] 00000020:00200000:0.0:1767316885.450555:0:82410:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 14) 2048 0 00000080:00200000:0.0:1767316885.450557:0:82410:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:0.0:1767316885.450566:0:82410:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1767316885.450575:0:82410:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 14) 14, 14 00020000:00200000:0.0:1767316885.450579:0:82410:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316885.450600:0:82410:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:0.0:1767316885.450620:0:82410:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:0.0:1767316885.450624:0:82410:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9030, osc lock ffff9cfe201db300, flags 0x40000 00000080:00200000:0.0:1767316885.450632:0:82410:0:(vvp_io.c:827:vvp_io_read_start()) f212a.sanity-flr: read [0, 14) 00000001:00010000:0.0:1767316885.450638:0:82410:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:0.0:1767316885.450642:0:82410:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316885.450644:0:82410:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9ab0, osc lock ffff9cfe201db560, flags 0x400001002 00010000:00010000:0.0:1767316885.450658:0:82410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.450669:0:82410:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316885.450695:0:82410:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 14, setting rss=14; kms=14, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316885.450705:0:82410:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316885.450708:0:82410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.450715:0:82410:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316885.450727:0:82410:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316885.450812:0:82410:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 8 00000020:00010000:0.0:1767316885.450817:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_release():245 00000020:00010000:0.0:1767316885.450820:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316885.450823:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9ab0 (ffff9cfe0e4c85a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316885.450828:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316885.450830:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9ab0 (ffff9cfe0e4c8a28/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316885.450841:0:82410:0:(vvp_io.c:886:vvp_io_read_start()) count:14 iocb pos:0 00000080:00200000:0.0:1767316885.450848:0:82410:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), size=14 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:0.0:1767316885.450896:0:82410:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1767316885.450898:0:82410:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 14 count 14 file_offset 14 00000020:00010000:0.0:1767316885.450903:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284038 (ffff9cfe0e4c8a28/0) at cl_lock_release():245 00000020:00010000:0.0:1767316885.450905:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284038 (ffff9cfe0e4c8a28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316885.450908:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9030 (ffff9cfe0e4c85a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316885.450911:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284038 (ffff9cfe0e4c8a28/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316885.450913:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9030 (ffff9cfe0e4c8a28/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316885.450923:0:82410:0:(vvp_io.c:518:vvp_io_advance()) advancing 14 bytes 00000020:00200000:0.0:1767316885.450927:0:82410:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1767316885.450951:0:49615:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe214173c0 00000008:00100000:0.0:1767316885.451003:0:49615:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe191d8a80 - object 0x280000400:161 offset 0<>14 00000100:00100000:1.0:1767316885.451103:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894014464:192.168.202.121@tcp:3:lfs.0 00000100:00100000:3.0:1767316885.454127:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316885.454220:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939788544 00000100:00100000:2.0:1767316885.454230:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939788544 00000100:00100000:2.0:1767316885.454286:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10192 00000100:00100000:2.0:1767316885.454296:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:36248:x1853163939788544:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316885.454315:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316885.454386:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316885.454393:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:36248:x1853163939788544:12345-192.168.202.121@tcp:104: Request processed in 99us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316885.454400:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10192 00010000:00010000:0.0:1767316885.454714:0:63296:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316885.454721:0:63296:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.454740:0:63296:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d000 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316885.454746:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400020000 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316885.454767:0:63296:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767316885.454779:0:63296:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1767316885.454821:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400020020 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.454829:0:63296:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316885.454861:0:63296:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400020020 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.454869:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56a9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400020020 nid: local remote: 0x863eb2f6655ac36d expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.454890:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.454892:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.454894:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316885.455026:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894014592:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316885.460396:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894014592:192.168.202.121@tcp:103:ldlm_bl.0 00000008:00010000:1.0:1767316885.460613:0:2503:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe214173c0 00000020:00200000:1.0:1767316885.460620:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:1.0:1767316885.460627:0:2503:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 14 00000020:00200000:1.0:1767316885.460635:0:2503:0:(cl_io.c:1643:__ll_dio_user_copy()) count 14, offset 0, pos 0, cdp_page_count 1 00000020:00200000:1.0:1767316885.460647:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:1.0:1767316885.460704:0:2503:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe214173c0 00000100:00100000:1.0:1767316885.460725:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894014464:192.168.202.121@tcp:3:lfs.0 00000080:00200000:0.0:1767316885.460850:0:82410:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767316885.460864:0:82410:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316885.460882:0:82410:0:(file.c:2142:ll_file_io_generic()) f212a.sanity-flr: 1 io complete with rc: 0, result: 14, restart: 0 00000020:00200000:0.0:1767316885.460886:0:82410:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316885.460893:0:82410:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 14 00000080:00200080:0.0:1767316885.460911:0:82410:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=0 00000080:00200080:0.0:1767316885.460948:0:82410:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=2 00000080:00200008:0.0:1767316885.460956:0:82410:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316885.460964:0:82410:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:0.0:1767316885.461002:0:82410:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316885.461020:0:82410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.461035:0:82410:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.461043:0:82410:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316885.461051:0:82410:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:0.0:1767316885.461055:0:82410:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56ab0 00000080:00010000:0.0:1767316885.461281:0:82410:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ab0 from it ffffa99f40c8fcd8 00010000:00010000:0.0:1767316885.461287:0:82410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.461297:0:82410:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316885.461326:0:82410:0:(file.c:2474:do_file_read_iter()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], ppos: 0, count: 14 00000080:00200000:0.0:1767316885.461333:0:82410:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:0.0:1767316885.461345:0:82410:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316885.461348:0:82410:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:0.0:1767316885.461369:0:82410:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316885.461376:0:82410:0:(file.c:1994:ll_file_io_generic()) f212a.sanity-flr: read ppos: 0, bytes: 14 00000080:00200000:0.0:1767316885.461385:0:82410:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 2 00000020:00200000:0.0:1767316885.461391:0:82410:0:(cl_io.c:214:cl_io_rw_init()) header@00000000698bd428[0x4, 2, [0x200000405:0x8e:0x0] hash] 00000020:00200000:0.0:1767316885.461393:0:82410:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 14) 2048 0 00000080:00200000:0.0:1767316885.461396:0:82410:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:0.0:1767316885.461403:0:82410:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1767316885.461409:0:82410:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 14) 14, 14 00020000:00200000:0.0:1767316885.461413:0:82410:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:0.0:1767316885.461426:0:82410:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:0.0:1767316885.461439:0:82410:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:0.0:1767316885.461443:0:82410:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9030, osc lock ffff9cfe201db300, flags 0x40000 00000080:00200000:0.0:1767316885.461451:0:82410:0:(vvp_io.c:827:vvp_io_read_start()) f212a.sanity-flr: read [0, 14) 00000001:00010000:0.0:1767316885.461457:0:82410:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:0.0:1767316885.461462:0:82410:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316885.461464:0:82410:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9ab0, osc lock ffff9cfe201db560, flags 0x400001002 00010000:00010000:0.0:1767316885.461477:0:82410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.461488:0:82410:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316885.461501:0:82410:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 14, setting rss=14; kms=14, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316885.461510:0:82410:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316885.461513:0:82410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 5/0,1 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.461521:0:82410:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316885.461542:0:82410:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316885.461549:0:82410:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 14 i_blocks 16 00000020:00010000:0.0:1767316885.461553:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_release():245 00000020:00010000:0.0:1767316885.461556:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316885.461559:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9ab0 (ffff9cfe0e4c85a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316885.461562:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316885.461565:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9ab0 (ffff9cfe0e4c8a28/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316885.461573:0:82410:0:(vvp_io.c:886:vvp_io_read_start()) count:14 iocb pos:0 00000080:00200000:0.0:1767316885.461579:0:82410:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), size=14 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:0.0:1767316885.461625:0:82410:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1767316885.461628:0:82410:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 14 count 14 file_offset 14 00000020:00010000:0.0:1767316885.461634:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284038 (ffff9cfe0e4c8a28/0) at cl_lock_release():245 00000020:00010000:0.0:1767316885.461637:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284038 (ffff9cfe0e4c8a28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316885.461639:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9030 (ffff9cfe0e4c85a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316885.461642:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284038 (ffff9cfe0e4c8a28/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316885.461644:0:82410:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9030 (ffff9cfe0e4c8a28/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316885.461649:0:82410:0:(vvp_io.c:518:vvp_io_advance()) advancing 14 bytes 00000020:00200000:0.0:1767316885.461654:0:82410:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1767316885.461673:0:49615:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe21417e40 00000008:00100000:0.0:1767316885.461714:0:49615:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe191db480 - object 0x2c0000400:160 offset 0<>14 00000100:00100000:1.0:1767316885.461845:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894014720:192.168.202.121@tcp:3:lfs.0 00000100:00100000:2.0:1767316885.464525:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316885.464812:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939788672 00000100:00100000:3.0:1767316885.464823:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939788672 00000100:00100000:3.0:1767316885.464913:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10193 00000100:00100000:3.0:1767316885.464923:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36248:x1853163939788672:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316885.464941:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316885.465104:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316885.465112:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:36248:x1853163939788672:12345-192.168.202.121@tcp:104: Request processed in 190us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316885.465119:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10193 00010000:00010000:0.0:1767316885.466346:0:49629:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316885.466358:0:49629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.466370:0:49629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05094200 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316885.466376:0:49629:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316885.466413:0:49629:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767316885.466425:0:49629:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1767316885.466470:0:49629:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.466478:0:49629:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316885.466512:0:49629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.466520:0:49629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56a94 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac35f expref: -99 pid: 82406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.466542:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.466544:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.466546:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316885.466629:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894014848:192.168.202.121@tcp:103:ldlm_bl.0 00000008:00010000:0.0:1767316885.470621:0:2503:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe21417e40 00000020:00200000:0.0:1767316885.470633:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1767316885.470640:0:2503:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 14 00000020:00200000:0.0:1767316885.470648:0:2503:0:(cl_io.c:1643:__ll_dio_user_copy()) count 14, offset 0, pos 0, cdp_page_count 1 00000020:00200000:0.0:1767316885.470660:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767316885.470680:0:2503:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe21417e40 00000100:00100000:0.0:1767316885.470703:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894014720:192.168.202.121@tcp:3:lfs.0 00000080:00200000:2.0:1767316885.470787:0:82410:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767316885.470801:0:82410:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316885.470806:0:82410:0:(file.c:2142:ll_file_io_generic()) f212a.sanity-flr: 1 io complete with rc: 0, result: 14, restart: 0 00000020:00200000:2.0:1767316885.470823:0:82410:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316885.470830:0:82410:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 14 00000080:00200080:2.0:1767316885.470848:0:82410:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=0 00000100:00100000:1.0:1767316885.474036:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894014848:192.168.202.121@tcp:103:ldlm_bl.0 00000080:00200080:2.0:1767316885.482670:0:82410:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=c00c66f3 arg=7fff79bebd04 00010000:00010000:2.0:1767316885.482860:0:82410:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x863eb2f6655ac3e4 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.482916:0:82410:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 1/0,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x863eb2f6655ac3e4 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.482924:0:82410:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1767316885.482946:0:82410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82410:1853163894014976:192.168.202.121@tcp:103:lfs.0 00000100:00100000:2.0:1767316885.483248:0:82410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe09f07b40 going to sleep for 11 seconds 00000100:00100000:2.0:1767316885.486332:0:82410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82410:1853163894014976:192.168.202.121@tcp:103:lfs.0 00010000:00010000:2.0:1767316885.486359:0:82410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56abe lrc: 0/0,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x863eb2f6655ac3e4 expref: -99 pid: 82410 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316885.486419:0:82410:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3ce00 x1853163894014336/t8589937387(8589937387) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767316885.486431:0:82410:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767316885.486437:0:82410:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29108700 x1853163894015232/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767316885.486459:0:82410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82410:1853163894015232:192.168.202.121@tcp:35:lfs.0 00000100:00100000:2.0:1767316885.486533:0:82410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe09f07b40 going to sleep for 11 seconds 00000100:00100000:2.0:1767316885.489412:0:82410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82410:1853163894015232:192.168.202.121@tcp:35:lfs.0 00000002:00100000:2.0:1767316885.489448:0:82410:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3ce00 x1853163894014336/t8589937387(8589937387) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1767316885.489513:0:82410:0:(file.c:424:ll_file_release()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), flags 154000 00010000:00010000:2.0:1767316885.489541:0:82410:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316885.500748:0:82411:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316885.500779:0:82411:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316885.500795:0:82411:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.500809:0:82411:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316885.500817:0:82411:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316885.500825:0:82411:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316885.500828:0:82411:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:2.0:1767316885.500835:0:82411:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f41dabbf8 00010000:00010000:2.0:1767316885.500838:0:82411:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.500845:0:82411:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316885.500861:0:82411:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316885.500868:0:82411:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=265 00000080:00200000:2.0:1767316885.500873:0:82411:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), inode mode 81a4 mask 44 00000080:00200008:2.0:1767316885.500879:0:82411:0:(file.c:1001:ll_file_open()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), flags 154400 00000080:00200000:2.0:1767316885.500943:0:82411:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), inode mode 81a4 mask 4 00000080:00200000:2.0:1767316885.500951:0:82411:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), xattr lov 00000080:00200008:2.0:1767316885.501003:0:82411:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316885.501009:0:82411:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:2.0:1767316885.501023:0:82411:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316885.501031:0:82411:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316885.501041:0:82411:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316885.501047:0:82411:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316885.501051:0:82411:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:2.0:1767316885.501054:0:82411:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56ab0 00000080:00010000:2.0:1767316885.501057:0:82411:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ab0 from it ffffa99f41dabcd8 00010000:00010000:2.0:1767316885.501230:0:82411:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316885.501239:0:82411:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767316885.501272:0:82411:0:(file.c:424:ll_file_release()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), flags 154000 00010000:00010000:2.0:1767316885.501286:0:82411:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316885.501312:0:82411:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316885.501320:0:82411:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316885.501326:0:82411:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.501334:0:82411:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316885.501346:0:82411:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316885.501351:0:82411:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316885.501353:0:82411:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:2.0:1767316885.501357:0:82411:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f41dabbf8 00010000:00010000:2.0:1767316885.501361:0:82411:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.501368:0:82411:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316885.501377:0:82411:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316885.501381:0:82411:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=265 00000080:00200000:2.0:1767316885.501384:0:82411:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), inode mode 81a4 mask 46 00000080:00200008:2.0:1767316885.501389:0:82411:0:(file.c:1001:ll_file_open()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), flags 100002 00000002:00010000:2.0:1767316885.501400:0:82411:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 04240100003 00010000:00010000:2.0:1767316885.501448:0:82411:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82411 initiator: MDT0 00010000:00010000:2.0:1767316885.501456:0:82411:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82411 initiator: MDT0 00000020:00100000:2.0:1767316885.501467:0:82411:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767316885.501479:0:82411:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29108700 x1853163894015488/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767316885.501488:0:82411:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82411 initiator: MDT0 00000100:00100000:2.0:1767316885.501509:0:82411:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82411:1853163894015488:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316885.501694:0:82411:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe09f07b40 going to sleep for 11 seconds 00000100:00100000:3.0:1767316885.505732:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316885.505814:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939788800 00000100:00100000:2.0:1767316885.505825:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939788800 00000100:00100000:2.0:1767316885.505881:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10194 00000100:00100000:2.0:1767316885.505890:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15469:x1853163939788800:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316885.505908:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316885.506010:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316885.506017:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15469:x1853163939788800:12345-192.168.202.121@tcp:104: Request processed in 128us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316885.506024:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10194 00010000:00010000:0.0:1767316885.506105:0:63143:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316885.506113:0:63143:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.506122:0:63143:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316885.506141:0:63143:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.506150:0:63143:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.506158:0:63143:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.506183:0:63143:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.506223:0:63143:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.506229:0:63143:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316885.506251:0:63143:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.506258:0:63143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ab0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac3c1 expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.506272:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.506274:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.506276:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316885.506283:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316885.506296:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894015616:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316885.511075:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894015616:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316885.511944:0:82411:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82411:1853163894015488:192.168.202.121@tcp:101:lfs.0 00010000:00010000:2.0:1767316885.511968:0:82411:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.511995:0:82411:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.512003:0:82411:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.512016:0:82411:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.512026:0:82411:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.512057:0:82411:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.512076:0:82411:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.512559:0:82411:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316885.512572:0:82411:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe29108700 x1853163894015488/t8589937389(8589937389) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767316885.512584:0:82411:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29108700 x1853163894015488/t8589937389(8589937389) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316885.512599:0:82411:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.512609:0:82411:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 8 res 8589935621/142 (0 0) 00000080:00200000:2.0:1767316885.512615:0:82411:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767316885.512909:0:82411:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 14 00000080:00010000:2.0:1767316885.512916:0:82411:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56ac5 00000080:00010000:2.0:1767316885.512923:0:82411:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ac5 from it ffffa99f41dabbf0 00010000:00010000:2.0:1767316885.512927:0:82411:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.512935:0:82411:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316885.512973:0:82411:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29108700 x1853163894015488/t8589937389(8589937389) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767316885.513340:0:82411:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), inode mode 81a4 mask 4 00000080:00200000:2.0:1767316885.513350:0:82411:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), xattr lov 00000080:00200008:2.0:1767316885.513378:0:82411:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316885.513386:0:82411:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:2.0:1767316885.513401:0:82411:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316885.513410:0:82411:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 30 res 8589935621/142 (0 0) 00010000:00010000:2.0:1767316885.513454:0:82411:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 82411 initiator: MDT0 00010000:00010000:2.0:1767316885.513462:0:82411:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82411 initiator: MDT0 00010000:00010000:2.0:1767316885.513473:0:82411:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82411 initiator: MDT0 00000100:00100000:2.0:1767316885.513495:0:82411:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82411:1853163894015744:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316885.513645:0:82411:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe19213240 going to sleep for 11 seconds 00000100:00100000:3.0:1767316885.517478:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316885.517559:0:42041:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767316885.517577:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939788928 00000100:00100000:3.0:1767316885.517585:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939788928 00000100:00100000:3.0:1767316885.517665:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10195 00000100:00100000:3.0:1767316885.517677:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29095850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15469:x1853163939788928:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316885.517718:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316885.517798:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316885.517805:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29095850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15469:x1853163939788928:12345-192.168.202.121@tcp:104: Request processed in 131us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316885.517812:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10195 00010000:00010000:0.0:1767316885.517872:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316885.517886:0:59093:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.517894:0:59093:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05095000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316885.517899:0:59093:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.517907:0:59093:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.517916:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.517944:0:59093:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.517992:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.517999:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316885.518031:0:59093:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 1/0,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.518038:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56ac5 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x8e:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac407 expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.518053:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.518055:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316885.518057:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316885.518076:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316885.518109:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894015872:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316885.521956:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894015872:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316885.522904:0:82411:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82411:1853163894015744:192.168.202.121@tcp:101:lfs.0 00010000:00010000:2.0:1767316885.522924:0:82411:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.522936:0:82411:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.522947:0:82411:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.522971:0:82411:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.522994:0:82411:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.523003:0:82411:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.523011:0:82411:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316885.523023:0:82411:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe29109f80 x1853163894015744/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/824 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316885.523034:0:82411:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316885.523047:0:82411:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316885.523456:0:82411:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:2.0:1767316885.523466:0:82411:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767316885.523517:0:82411:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 14 00000080:00200000:2.0:1767316885.523533:0:82411:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 5 -> 5 00000080:00010000:2.0:1767316885.523538:0:82411:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56acc 00000080:00010000:2.0:1767316885.523544:0:82411:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:2.0:1767316885.523547:0:82411:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56acc from it ffffa99f41dabcd8 00010000:00010000:2.0:1767316885.523557:0:82411:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316885.523567:0:82411:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 3 00000080:00200080:2.0:1767316885.523639:0:82411:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=801066da arg=7ffe791549e0 00000080:00200000:2.0:1767316885.523652:0:82411:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1767316885.523664:0:82411:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316885.523667:0:82411:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767316885.523673:0:82411:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:3.0:1767316885.523960:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894016000:192.168.202.121@tcp:1:lfs.0 00000100:00100000:3.0:1767316885.527954:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894016000:192.168.202.121@tcp:1:lfs.0 00000080:00200000:2.0:1767316885.528223:0:82411:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), inode mode 81a4 mask 2 00000080:00200000:2.0:1767316885.528238:0:82411:0:(xattr.c:406:ll_xattr_set()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), xattr lov.set.flags 00010000:00010000:2.0:1767316885.528283:0:82411:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56a39 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ac26a expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.528338:0:82411:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56a39 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac26a expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.528346:0:82411:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767316885.528349:0:82411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56a39 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac26a expref: -99 pid: 82258 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767316885.528368:0:82411:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767316885.528376:0:82411:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29109f80 x1853163894016256/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 624/440 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767316885.528398:0:82411:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82411:1853163894016256:192.168.202.121@tcp:36:lfs.0 00000100:00100000:2.0:1767316885.528486:0:82411:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe19213240 going to sleep for 11 seconds 00000100:00100000:2.0:1767316885.531752:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316885.531795:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316885.531890:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316885.531920:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939789056 00000100:00100000:2.0:1767316885.531929:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939789056 00000100:00100000:2.0:1767316885.531967:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939789184 00000100:00100000:2.0:1767316885.531970:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939789184 00000100:00100000:2.0:1767316885.531991:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939789312 00000100:00100000:2.0:1767316885.531994:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939789312 00000100:00100000:2.0:1767316885.532009:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10196 00000100:00100000:2.0:1767316885.532018:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+7:15469:x1853163939789056:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316885.532036:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1767316885.532350:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10197 00000100:00100000:3.0:1767316885.532360:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+7:15469:x1853163939789184:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316885.532369:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316885.532976:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316885.532998:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+7:15469:x1853163939789184:12345-192.168.202.121@tcp:104: Request processed in 639us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316885.533006:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10197 00000100:00100000:3.0:1767316885.533028:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10198 00000100:00100000:3.0:1767316885.533035:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+6:15469:x1853163939789312:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316885.533044:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533371:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1767316885.533380:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533389:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316885.533394:0:42049:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533402:0:42049:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533411:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533435:0:42049:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533471:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533478:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316885.533501:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533508:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56aa2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac37b expref: -99 pid: 82406 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533521:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1767316885.533534:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533541:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05095a00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316885.533544:0:42049:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533551:0:42049:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533558:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533569:0:42049:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533592:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533598:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316885.533604:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533611:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095a00/0xd9a0da65fad56acc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac41c expref: -99 pid: 82411 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533621:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316885.533624:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533630:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2de00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316885.533641:0:42049:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533648:0:42049:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.533655:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1767316885.533906:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894016384:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316885.533971:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316885.533989:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894016512:192.168.202.121@tcp:103:ldlm_bl.0 00000002:00100000:0.0:1767316885.534053:0:42049:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3e680 x1853163894014080/t8589937386(8589937386) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316885.534434:0:42049:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1767316885.534441:0:42049:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9500 x1853163894016768/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316885.534459:0:42049:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_02:9a586faf-b087-472d-9665-d3bc7d15b908:42049:1853163894016768:192.168.202.121@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1767316885.534492:0:42049:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe290e7cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1767316885.534589:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1767316885.534598:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+6:15469:x1853163939789312:12345-192.168.202.121@tcp:104: Request processed in 1562us (2771us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316885.534618:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10198 00000100:00100000:1.0:1767316885.538259:0:42049:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_02:9a586faf-b087-472d-9665-d3bc7d15b908:42049:1853163894016768:192.168.202.121@tcp:35:ldlm_bl.0 00000002:00100000:1.0:1767316885.538297:0:42049:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3e680 x1853163894014080/t8589937386(8589937386) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316885.538333:0:42049:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:1.0:1767316885.538378:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.538386:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316885.538408:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.538416:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ab7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac3cf expref: -99 pid: 82410 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.538438:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316885.538441:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316885.538443:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316885.538452:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316885.538466:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894016896:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1767316885.539417:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1767316885.539434:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15469:x1853163939789056:12345-192.168.202.121@tcp:104: Request processed in 7412us (7687us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316885.539445:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10196 00010000:00010000:1.0:1767316885.540415:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316885.541536:0:82411:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82411:1853163894016256:192.168.202.121@tcp:36:lfs.0 00000080:00200008:2.0:1767316885.541584:0:82411:0:(file.c:424:ll_file_release()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), flags 100002 00000100:00100000:1.0:1767316885.541604:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894016896:192.168.202.121@tcp:103:ldlm_bl.0 00000002:00100000:2.0:1767316885.541641:0:82411:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe29108700 x1853163894015488/t8589937389(8589937389) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767316885.541652:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894016512:192.168.202.121@tcp:103:ldlm_bl.0 00000020:00100000:2.0:1767316885.541653:0:82411:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767316885.541658:0:82411:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29109880 x1853163894017152/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316885.541661:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894016384:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316885.541679:0:82411:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82411:1853163894017152:192.168.202.121@tcp:35:lfs.0 00000100:00100000:2.0:1767316885.541749:0:82411:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe19213240 going to sleep for 11 seconds 00000100:00100000:2.0:1767316885.544775:0:82411:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82411:1853163894017152:192.168.202.121@tcp:35:lfs.0 00000002:00100000:2.0:1767316885.544816:0:82411:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe29108700 x1853163894015488/t8589937389(8589937389) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767316885.551561:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:2.0:1767316885.564162:0:82412:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316885.564682:0:82412:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316885.564713:0:82412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.564859:0:82412:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316885.564869:0:82412:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316885.564878:0:82412:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316885.564882:0:82412:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:2.0:1767316885.564889:0:82412:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f40dd3bf8 00010000:00010000:2.0:1767316885.564894:0:82412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.564903:0:82412:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316885.564917:0:82412:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316885.564932:0:82412:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), file ffff9cfe037ea780, open_flags 18800, mode 0 opened 0 00000080:00200000:2.0:1767316885.564937:0:82412:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open 00000002:00010000:2.0:1767316885.564951:0:82412:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0304001 00010000:00010000:2.0:1767316885.565015:0:82412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ad3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82412 initiator: MDT0 00010000:00010000:2.0:1767316885.565034:0:82412:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ad3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82412 initiator: MDT0 00000020:00100000:2.0:1767316885.565047:0:82412:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767316885.565068:0:82412:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29109880 x1853163894017408/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767316885.565356:0:82412:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ad3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82412 initiator: MDT0 00000100:00100000:2.0:1767316885.565384:0:82412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82412:1853163894017408:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316885.565573:0:82412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe19213240 going to sleep for 11 seconds 00000100:00100000:2.0:1767316885.570947:0:82412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82412:1853163894017408:192.168.202.121@tcp:101:lfs.0 00010000:00010000:2.0:1767316885.570971:0:82412:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ad3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82412 initiator: MDT0 00010000:00010000:2.0:1767316885.570994:0:82412:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ad3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82412 initiator: MDT0 00010000:00010000:2.0:1767316885.571000:0:82412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ad3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82412 initiator: MDT0 00010000:00010000:2.0:1767316885.571007:0:82412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ad3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82412 initiator: MDT0 00010000:00010000:2.0:1767316885.571014:0:82412:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ad3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82412 initiator: MDT0 00010000:00010000:2.0:1767316885.571021:0:82412:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05094800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:2.0:1767316885.571026:0:82412:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ad3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82412 initiator: MDT0 00010000:00010000:2.0:1767316885.571048:0:82412:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ad3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82412 initiator: MDT0 00010000:00010000:2.0:1767316885.571055:0:82412:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ad3 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 82412 initiator: MDT0 00010000:00010000:2.0:1767316885.571898:0:82412:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767316885.571907:0:82412:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ad3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82412 initiator: MDT0 00010000:00010000:2.0:1767316885.571914:0:82412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ad3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82412 initiator: MDT0 00000002:00100000:2.0:1767316885.571933:0:82412:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=-20 req@ffff9cfe29109880 x1853163894017408/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/608 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767316885.571947:0:82412:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc -20 00010000:00010000:0.0:1767316885.572643:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1767316885.574947:0:82412:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:3.0:1767316885.574988:0:82412:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316885.575005:0:82412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316885.575020:0:82412:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316885.575027:0:82412:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316885.575035:0:82412:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:3.0:1767316885.575039:0:82412:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:3.0:1767316885.575045:0:82412:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f40dd3bb0 00010000:00010000:3.0:1767316885.575049:0:82412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316885.575058:0:82412:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316885.575400:0:82412:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 44 00000080:00200008:3.0:1767316885.575412:0:82412:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags 304000 00000080:00200080:3.0:1767316885.575446:0:82412:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148) cmd=c0086915 arg=15353d0 00000100:00100000:3.0:1767316885.575517:0:82412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82412:1853163894017536:192.168.202.121@tcp:34:lfs.0 00000100:00100000:3.0:1767316885.579430:0:82412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18fcaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1767316885.579479:0:82412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82412:1853163894017536:192.168.202.121@tcp:34:lfs.0 00000080:00200008:3.0:1767316885.582473:0:82412:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags 304000 00000080:00200000:1.0:1767316885.593396:0:82414:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316885.593425:0:82414:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316885.593441:0:82414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.593455:0:82414:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316885.593463:0:82414:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316885.593470:0:82414:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316885.593474:0:82414:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:1.0:1767316885.593481:0:82414:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f41e2fb58 00010000:00010000:1.0:1767316885.593485:0:82414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.593493:0:82414:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316885.593507:0:82414:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316885.593518:0:82414:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=9 00000080:00200000:1.0:1767316885.593522:0:82414:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316885.593533:0:82414:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316885.593573:0:82414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82414 initiator: MDT0 00010000:00010000:1.0:1767316885.593590:0:82414:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82414 initiator: MDT0 00010000:00010000:1.0:1767316885.593601:0:82414:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82414 initiator: MDT0 00000100:00100000:1.0:1767316885.593625:0:82414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82414:1853163894017664:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316885.593733:0:82414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316885.596795:0:82414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82414:1853163894017664:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316885.596820:0:82414:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.596841:0:82414:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.596848:0:82414:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.596860:0:82414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.596871:0:82414:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.596882:0:82414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.596889:0:82414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.596915:0:82414:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316885.596927:0:82414:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3e680 x1853163894017664/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/824 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316885.596938:0:82414:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316885.596950:0:82414:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.596960:0:82414:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767316885.596967:0:82414:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316885.597019:0:82414:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316885.597028:0:82414:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316885.597032:0:82414:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316885.597038:0:82414:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316885.597180:0:82414:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316885.597250:0:82414:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 14 00000080:00200000:1.0:1767316885.597254:0:82414:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x8e:0x0](ffff9cfe0edb42c8): rc = 0 00000080:00200000:1.0:1767316885.597271:0:82414:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 4294967294 -> 6 00000080:00010000:1.0:1767316885.597278:0:82414:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56ada 00000080:00010000:1.0:1767316885.597289:0:82414:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:1.0:1767316885.597293:0:82414:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ada from it ffffa99f41e2fb20 00010000:00010000:1.0:1767316885.597296:0:82414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.597316:0:82414:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767316885.597356:0:82414:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316885.597363:0:82414:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:1.0:1767316885.597384:0:82414:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316885.597393:0:82414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.597402:0:82414:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316885.597408:0:82414:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316885.597412:0:82414:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:1.0:1767316885.597415:0:82414:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56ada 00000080:00010000:1.0:1767316885.597419:0:82414:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ada from it ffffa99f41e2fcb8 00010000:00010000:1.0:1767316885.597422:0:82414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.597429:0:82414:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316885.597479:0:82414:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316885.597488:0:82414:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316885.597495:0:82414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.597513:0:82414:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316885.597520:0:82414:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316885.597524:0:82414:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316885.597527:0:82414:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:1.0:1767316885.597530:0:82414:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f41e2fbf8 00010000:00010000:1.0:1767316885.597534:0:82414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.597542:0:82414:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316885.597549:0:82414:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316885.597555:0:82414:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=265 00000080:00200000:1.0:1767316885.597560:0:82414:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), inode mode 81a4 mask 44 00000080:00200008:1.0:1767316885.597568:0:82414:0:(file.c:1001:ll_file_open()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), flags 154400 00000002:00010000:1.0:1767316885.597582:0:82414:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114401 00010000:00010000:1.0:1767316885.597628:0:82414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56ae1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82414 initiator: MDT0 00010000:00010000:1.0:1767316885.597635:0:82414:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56ae1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82414 initiator: MDT0 00000020:00100000:1.0:1767316885.597646:0:82414:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316885.597653:0:82414:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3e680 x1853163894017920/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316885.597661:0:82414:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56ae1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82414 initiator: MDT0 00000100:00100000:1.0:1767316885.597690:0:82414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82414:1853163894017920:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316885.598552:0:82414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316885.603936:0:82414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82414:1853163894017920:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316885.603968:0:82414:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56ae1 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac47e expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.603990:0:82414:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56ae1 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac47e expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.604003:0:82414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56ae1 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac47e expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.604013:0:82414:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56ae1 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac47e expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316885.604026:0:82414:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe18f3e680 x1853163894017920/t8589937393(8589937393) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316885.604039:0:82414:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3e680 x1853163894017920/t8589937393(8589937393) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316885.604051:0:82414:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac47e expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316885.604074:0:82414:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac47e expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.604928:0:82414:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767316885.604946:0:82414:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316885.605277:0:82414:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8e:0x0], updating i_size 14 00000080:00200000:1.0:1767316885.605296:0:82414:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x8e:0x0]: layout version change: 6 -> 6 00000080:00010000:1.0:1767316885.605302:0:82414:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56ae1 00000080:00010000:1.0:1767316885.605309:0:82414:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ae1 from it ffffa99f41e2fbf0 00010000:00010000:1.0:1767316885.605313:0:82414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac47e expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316885.605324:0:82414:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56ae1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac47e expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767316885.605359:0:82414:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3e680 x1853163894017920/t8589937393(8589937393) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:1.0:1767316885.605461:0:82414:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=c00c66f3 arg=7ffe6ac4bec4 00000002:00010000:1.0:1767316885.605483:0:82414:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000405:0x8e:0x0], intent: open flags 01004040000001 00010000:00010000:1.0:1767316885.605532:0:82414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 82414 initiator: MDT0 00010000:00010000:1.0:1767316885.605540:0:82414:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82414 initiator: MDT0 00000020:00100000:1.0:1767316885.605552:0:82414:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316885.605559:0:82414:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3fb80 x1853163894018176/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316885.605568:0:82414:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x81000000000000 pid: 82414 initiator: MDT0 00000100:00100000:1.0:1767316885.605589:0:82414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82414:1853163894018176:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316885.606026:0:82414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316885.610431:0:82414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82414:1853163894018176:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316885.610602:0:82414:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac493 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.610615:0:82414:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac493 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.610631:0:82414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac493 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.610643:0:82414:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac493 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.610656:0:82414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac493 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.610664:0:82414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac493 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.610672:0:82414:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac493 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316885.610684:0:82414:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff9cfe18f3fb80 x1853163894018176/t8589937394(8589937394) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316885.610874:0:82414:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3fb80 x1853163894018176/t8589937394(8589937394) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316885.610892:0:82414:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac493 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316885.610929:0:82414:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 2 res 8589935621/142 (0 0) 00000080:00200000:1.0:1767316885.610936:0:82414:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8e:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1767316885.611049:0:82414:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3fb80 x1853163894018176/t8589937394(8589937394) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767316885.611058:0:82414:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56ae8 00000080:00010000:0.0:1767316885.615888:0:82414:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ae8 from it ffffa99f41e2fcc0 00010000:00010000:0.0:1767316885.615894:0:82414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac493 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316885.615908:0:82414:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac493 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316885.616367:0:82414:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1767316885.616378:0:82414:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), xattr lov 00000080:00200008:0.0:1767316885.616409:0:82414:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316885.616418:0:82414:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:0.0:1767316885.616444:0:82414:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316885.616460:0:82414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.616473:0:82414:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.616481:0:82414:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316885.616490:0:82414:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:0.0:1767316885.616493:0:82414:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56ada 00000080:00010000:0.0:1767316885.616497:0:82414:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ada from it ffffa99f41e2fcd8 00010000:00010000:0.0:1767316885.616500:0:82414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.616508:0:82414:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00000080:00200080:0.0:1767316885.616795:0:82414:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=2 00000080:00200008:0.0:1767316885.616804:0:82414:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316885.616808:0:82414:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:0.0:1767316885.616820:0:82414:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316885.616826:0:82414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.616840:0:82414:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316885.616847:0:82414:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316885.616852:0:82414:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:0.0:1767316885.616854:0:82414:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56ada 00000080:00010000:0.0:1767316885.616858:0:82414:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ada from it ffffa99f41e2fcd8 00010000:00010000:0.0:1767316885.616861:0:82414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316885.616869:0:82414:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316885.616887:0:82414:0:(file.c:2474:do_file_read_iter()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0], ppos: 0, count: 14 00000080:00200000:0.0:1767316885.616896:0:82414:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316885.616906:0:82414:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316885.616910:0:82414:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:0.0:1767316885.616922:0:82414:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316885.616932:0:82414:0:(file.c:1994:ll_file_io_generic()) f212a.sanity-flr: read ppos: 0, bytes: 14 00000080:00200000:0.0:1767316885.616941:0:82414:0:(file.c:1759:ll_io_set_mirror()) f212a.sanity-flr: desiginated mirror: 2 00000020:00200000:0.0:1767316885.616948:0:82414:0:(cl_io.c:214:cl_io_rw_init()) header@00000000698bd428[0x4, 2, [0x200000405:0x8e:0x0] hash] 00000020:00200000:0.0:1767316885.616950:0:82414:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 14) 2048 0 00000080:00200000:0.0:1767316885.616952:0:82414:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 6 restore needed 0 00000080:00200000:0.0:1767316885.616960:0:82414:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1767316885.616967:0:82414:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 14) 14, 14 00020000:00200000:0.0:1767316885.616970:0:82414:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:0.0:1767316885.616997:0:82414:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:0.0:1767316885.617010:0:82414:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:0.0:1767316885.617018:0:82414:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9030, osc lock ffff9cfe201db300, flags 0x40000 00000080:00200000:0.0:1767316885.617027:0:82414:0:(vvp_io.c:827:vvp_io_read_start()) f212a.sanity-flr: read [0, 14) 00000001:00010000:0.0:1767316885.617034:0:82414:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8e:0x0] 00000008:00010000:0.0:1767316885.617039:0:82414:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316885.617041:0:82414:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9ab0, osc lock ffff9cfe201db560, flags 0x400001002 00010000:00010000:0.0:1767316885.617125:0:82414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aef lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82414 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316885.617134:0:82414:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aef lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82414 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316885.617165:0:82414:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1767316885.617630:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894018304:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316885.620879:0:2502:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aef lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.620905:0:2502:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aef lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac4a1 expref: -99 pid: 82414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.620920:0:2502:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aef lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac4a1 expref: -99 pid: 82414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.620932:0:2502:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aef lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac4a1 expref: -99 pid: 82414 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316885.620946:0:2502:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 14, setting rss=14; kms=14, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aef lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac4a1 expref: -99 pid: 82414 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316885.620956:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767316885.621028:0:2502:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aef lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac4a1 expref: -99 pid: 82414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.621037:0:2502:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aef lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac4a1 expref: -99 pid: 82414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.621075:0:2502:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aef lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac4a1 expref: -99 pid: 82414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316885.621140:0:2502:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aef lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac4a1 expref: -99 pid: 82414 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316885.621164:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894018304:192.168.202.121@tcp:101:lfs.0 00000080:00200000:2.0:1767316885.621441:0:82414:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8e:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1767316885.621448:0:82414:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_release():245 00000020:00010000:2.0:1767316885.621452:0:82414:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316885.621457:0:82414:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9ab0 (ffff9cfe0e436758/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316885.621462:0:82414:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316885.621465:0:82414:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9ab0 (ffff9cfe0e436f38/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316885.621477:0:82414:0:(vvp_io.c:886:vvp_io_read_start()) count:14 iocb pos:0 00000080:00200000:2.0:1767316885.621485:0:82414:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), size=14 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00010000:2.0:1767316885.621497:0:82414:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe27576d58 (ffff9cfe0e436f38/0) at cl_lock_release():245 00000020:00010000:2.0:1767316885.621500:0:82414:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe27576d58 (ffff9cfe0e436f38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316885.621503:0:82414:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9030 (ffff9cfe0e436758/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316885.621506:0:82414:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe27576d58 (ffff9cfe0e436f38/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316885.621508:0:82414:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9030 (ffff9cfe0e436f38/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316885.621520:0:82414:0:(vvp_io.c:518:vvp_io_advance()) advancing 0 bytes 00000020:00200000:2.0:1767316885.621527:0:82414:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316885.621531:0:82414:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767316885.621540:0:82414:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316885.621544:0:82414:0:(file.c:2142:ll_file_io_generic()) f212a.sanity-flr: 1 io complete with rc: 0, result: 0, restart: 0 00000020:00200000:2.0:1767316885.621547:0:82414:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316885.621552:0:82414:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 0 00000080:00200080:2.0:1767316885.621566:0:82414:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=400866b1 arg=0 00000080:00200080:2.0:1767316885.621996:0:82414:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) cmd=c00c66f3 arg=7ffe6ac4bed4 00010000:00010000:2.0:1767316885.622010:0:82414:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x863eb2f6655ac493 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.622054:0:82414:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x863eb2f6655ac493 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316885.622072:0:82414:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1767316885.622127:0:82414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82414:1853163894018432:192.168.202.121@tcp:103:lfs.0 00000100:00100000:2.0:1767316885.622214:0:82414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe19213240 going to sleep for 11 seconds 00000100:00100000:3.0:1767316885.625425:0:82414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82414:1853163894018432:192.168.202.121@tcp:103:lfs.0 00010000:00010000:3.0:1767316885.625466:0:82414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ae8 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x8e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x863eb2f6655ac493 expref: -99 pid: 82414 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316885.625595:0:82414:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3fb80 x1853163894018176/t8589937394(8589937394) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767316885.625607:0:82414:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767316885.625612:0:82414:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29108700 x1853163894018688/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767316885.625634:0:82414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82414:1853163894018688:192.168.202.121@tcp:35:lfs.0 00000100:00100000:2.0:1767316885.625870:0:82414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe192139c0 going to sleep for 11 seconds 00000100:00100000:3.0:1767316885.629271:0:82414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82414:1853163894018688:192.168.202.121@tcp:35:lfs.0 00000002:00100000:3.0:1767316885.629308:0:82414:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3fb80 x1853163894018176/t8589937394(8589937394) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1767316885.629354:0:82414:0:(file.c:424:ll_file_release()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), flags 154000 00010000:00010000:3.0:1767316885.629377:0:82414:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56ae1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac47e expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1767316885.700389:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2505:1853163894018816:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316885.700492:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894019072:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316885.700519:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894019328:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316885.700549:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1767316885.700555:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894018944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316885.700578:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894019200:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316885.716506:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894018944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316885.716527:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894019200:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316885.716536:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2505:1853163894018816:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316885.716546:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894019072:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316885.716570:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894019328:192.168.202.121@tcp:400:kworker.0 00010000:00010000:2.0:1767316886.609798:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316887.630560:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767316888.650573:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316889.669286:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316890.694232:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1767316890.821537:0:81663:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x89:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:3.0:1767316890.821556:0:81663:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767316890.823584:0:81663:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x89:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1767316890.826986:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894019584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316890.827107:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894019840:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316890.827141:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1767316890.827148:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2505:1853163894019456:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316890.827174:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894019712:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316890.827195:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894019968:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316890.834561:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2505:1853163894019456:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316890.834596:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894019712:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316890.834606:0:2505:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9cfe08c17800: committing for last_committed 17179875393 gen 1 00000100:00100000:2.0:1767316890.834628:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894019968:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316890.834639:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894019584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316890.834758:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894019840:192.168.202.121@tcp:400:kworker.0 00000001:02000400:2.0:1767316891.095554:0:82979:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 212b: Testing lfs mirror verify --stale option ========================================================== 20:21:29 (1767316889) 00000080:00200000:0.0:1767316891.155097:0:82982:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316891.155128:0:82982:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316891.155147:0:82982:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.155163:0:82982:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316891.155172:0:82982:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316891.155180:0:82982:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316891.155185:0:82982:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:0.0:1767316891.155193:0:82982:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f40d17b58 00010000:00010000:0.0:1767316891.155197:0:82982:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.155206:0:82982:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316891.155234:0:82982:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316891.155247:0:82982:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=13 00000080:00200000:0.0:1767316891.155252:0:82982:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316891.155268:0:82982:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316891.157628:0:82982:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56af6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82982 initiator: MDT0 00010000:00010000:0.0:1767316891.157647:0:82982:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56af6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82982 initiator: MDT0 00010000:00010000:0.0:1767316891.157658:0:82982:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56af6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82982 initiator: MDT0 00000100:00100000:0.0:1767316891.157687:0:82982:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82982:1853163894020096:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316891.157789:0:82982:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b240 going to sleep for 11 seconds 00000100:00100000:0.0:1767316891.177592:0:82982:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82982:1853163894020096:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316891.177624:0:82982:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56af6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82982 initiator: MDT0 00010000:00010000:0.0:1767316891.177637:0:82982:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56af6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82982 initiator: MDT0 00010000:00010000:0.0:1767316891.177814:0:82982:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56af6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82982 initiator: MDT0 00010000:00010000:0.0:1767316891.177822:0:82982:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56af6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82982 initiator: MDT0 00010000:00010000:0.0:1767316891.177830:0:82982:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56af6 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82982 initiator: MDT0 00010000:00010000:0.0:1767316891.177846:0:82982:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037dc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316891.177851:0:82982:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56af6 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 82982 initiator: MDT0 00010000:00010000:0.0:1767316891.177858:0:82982:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56af6 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 82982 initiator: MDT0 00010000:00010000:0.0:1767316891.177865:0:82982:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56af6 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 82982 initiator: MDT0 00010000:00010000:0.0:1767316891.177871:0:82982:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316891.177878:0:82982:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56af6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82982 initiator: MDT0 00010000:00010000:0.0:1767316891.177885:0:82982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56af6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82982 initiator: MDT0 00000002:00100000:0.0:1767316891.177902:0:82982:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff9cfe191d9180 x1853163894020096/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/584 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316891.177916:0:82982:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1767316891.177960:0:82982:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.177971:0:82982:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767316891.177979:0:82982:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f40d17940 00010000:00010000:0.0:1767316891.177983:0:82982:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.177990:0:82982:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316891.178177:0:82982:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316891.178194:0:82982:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316891.178202:0:82982:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.178210:0:82982:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316891.178216:0:82982:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316891.178221:0:82982:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316891.178224:0:82982:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:0.0:1767316891.178229:0:82982:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f40d17be8 00010000:00010000:0.0:1767316891.178232:0:82982:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.178239:0:82982:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316891.178248:0:82982:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316891.178255:0:82982:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=16392 00000080:00200008:0.0:1767316891.178281:0:82982:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1767316891.178286:0:82982:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316891.178294:0:82982:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316891.178300:0:82982:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.178309:0:82982:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316891.178321:0:82982:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316891.178325:0:82982:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316891.178328:0:82982:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:0.0:1767316891.178331:0:82982:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f40d17cb8 00010000:00010000:0.0:1767316891.178334:0:82982:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.178341:0:82982:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316891.184049:0:82982:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1767316891.184063:0:82982:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316891.184105:0:82982:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.184121:0:82982:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.184136:0:82982:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.184143:0:82982:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316891.184150:0:82982:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316891.184154:0:82982:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:1.0:1767316891.184160:0:82982:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f40d17cb8 00010000:00010000:1.0:1767316891.184164:0:82982:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.184172:0:82982:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.184312:0:82982:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316891.184322:0:82982:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.184328:0:82982:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.184336:0:82982:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.184342:0:82982:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316891.184346:0:82982:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316891.184349:0:82982:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:1.0:1767316891.184353:0:82982:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f40d17b58 00010000:00010000:1.0:1767316891.184356:0:82982:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.184363:0:82982:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.184372:0:82982:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316891.184379:0:82982:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=8 00000080:00200000:1.0:1767316891.184396:0:82982:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316891.184404:0:82982:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.184409:0:82982:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.184417:0:82982:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.184433:0:82982:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316891.184437:0:82982:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316891.184440:0:82982:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:1.0:1767316891.184444:0:82982:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f40d17bf8 00010000:00010000:1.0:1767316891.184447:0:82982:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.184454:0:82982:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.184462:0:82982:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316891.184468:0:82982:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=777 00000080:00200000:1.0:1767316891.184472:0:82982:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316891.184478:0:82982:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.184484:0:82982:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.184491:0:82982:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.184497:0:82982:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316891.184501:0:82982:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316891.184503:0:82982:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56a55 00000080:00010000:1.0:1767316891.184507:0:82982:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a55 from it ffffa99f40d17b38 00010000:00010000:1.0:1767316891.184510:0:82982:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.184517:0:82982:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.184531:0:82982:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316891.184537:0:82982:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), file ffff9cfe113c9500, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1767316891.184546:0:82982:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open|creat 00000002:00010000:1.0:1767316891.184567:0:82982:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1767316891.184580:0:82982:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.187874:0:82982:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.187895:0:82982:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316891.187899:0:82982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56a55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac29b expref: -99 pid: 82404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.187954:0:82982:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82982 initiator: MDT0 00010000:00010000:1.0:1767316891.187962:0:82982:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82982 initiator: MDT0 00000020:00100000:1.0:1767316891.187975:0:82982:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316891.187989:0:82982:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3ca80 x1853163894020352/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 536/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316891.187999:0:82982:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82982 initiator: MDT0 00000100:00100000:1.0:1767316891.188024:0:82982:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ca80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82982:1853163894020352:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316891.188173:0:82982:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316891.195245:0:82982:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ca80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82982:1853163894020352:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316891.195274:0:82982:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.195312:0:82982:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 4/0,1 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.195321:0:82982:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 4/0,1 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.195332:0:82982:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.195342:0:82982:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.195355:0:82982:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.195371:0:82982:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.195379:0:82982:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316891.195390:0:82982:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff9cfe18f3ca80 x1853163894020352/t8589937396(8589937396) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 536/608 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316891.195402:0:82982:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3ca80 x1853163894020352/t8589937396(8589937396) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 536/608 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316891.195413:0:82982:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.195424:0:82982:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767316891.195430:0:82982:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316891.195442:0:82982:0:(namei.c:1569:ll_create_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open|creat 00000080:00200000:0.0:1767316891.195480:0:82982:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00200000:0.0:1767316891.195487:0:82982:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 0 00000080:00200000:0.0:1767316891.195559:0:82982:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1767316891.195565:0:82982:0:(namei.c:1535:ll_create_node()) setting l_ast_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316891.195569:0:82982:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56afd 00000080:00010000:0.0:1767316891.195579:0:82982:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00200008:0.0:1767316891.195591:0:82982:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 120501 00000002:00100000:0.0:1767316891.196249:0:82982:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3ca80 x1853163894020352/t8589937396(8589937396) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 536/608 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767316891.196293:0:82982:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56afd from it ffff9cfe0f27fd20 00010000:00010000:0.0:1767316891.196299:0:82982:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.196311:0:82982:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316891.196336:0:82982:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 40 00000080:00200000:0.0:1767316891.196385:0:82982:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 2 00000080:00200000:0.0:1767316891.196398:0:82982:0:(xattr.c:406:ll_xattr_set()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), xattr lov 00000002:00010000:0.0:1767316891.196415:0:82982:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:0.0:1767316891.196468:0:82982:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56b04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82982 initiator: MDT0 00010000:00010000:0.0:1767316891.196474:0:82982:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56b04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82982 initiator: MDT0 00000020:00100000:0.0:1767316891.196485:0:82982:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316891.196491:0:82982:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9180 x1853163894020608/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316891.196501:0:82982:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56b04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82982 initiator: MDT0 00000100:00100000:0.0:1767316891.196523:0:82982:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82982:1853163894020608:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316891.198795:0:82982:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b240 going to sleep for 11 seconds 00000100:00100000:3.0:1767316891.208047:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316891.208261:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939792000 00000100:00100000:2.0:1767316891.208271:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939792000 00000100:00100000:2.0:1767316891.208319:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10199 00000100:00100000:2.0:1767316891.208329:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939792000:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316891.208346:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316891.208424:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316891.208431:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939792000:12345-192.168.202.121@tcp:104: Request processed in 103us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316891.208439:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10199 00010000:00010000:0.0:1767316891.208664:0:63840:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316891.208672:0:63840:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.208694:0:63840:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316891.208700:0:63840:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.208709:0:63840:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.208717:0:63840:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316891.208740:0:63840:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:0.0:1767316891.208781:0:63840:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 2/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.208788:0:63840:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316891.208811:0:63840:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.208818:0:63840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56afd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac4d2 expref: -99 pid: 82982 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.208834:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316891.208836:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316891.208838:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316891.208854:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894020736:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316891.218918:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894020736:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316891.220851:0:82982:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937396 gen 1 00000100:00100000:1.0:1767316891.220877:0:82982:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe18f3e680 x1853163894017920/t8589937393(8589937393) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767316891.220889:0:82982:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe18f3ca80 x1853163894020352/t8589937396(8589937396) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 536/608 e 0 to 0 dl 1767316907 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767316891.220896:0:82982:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9cfe191d9180 x1853163894020608/t8589937397(8589937397) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316907 ref 3 fl Rpc:RPQU/604/0 rc 0/301 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767316891.220906:0:82982:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82982:1853163894020608:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316891.220924:0:82982:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56b04 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82982 initiator: MDT0 00010000:00010000:1.0:1767316891.220949:0:82982:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56b04 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 82982 initiator: MDT0 00010000:00010000:1.0:1767316891.220956:0:82982:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56b04 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 82982 initiator: MDT0 00010000:00010000:1.0:1767316891.220962:0:82982:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56b04 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 82982 initiator: MDT0 00010000:00010000:1.0:1767316891.220970:0:82982:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56b04 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 82982 initiator: MDT0 00010000:00010000:1.0:1767316891.220979:0:82982:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037dc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316891.220983:0:82982:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56b04 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 82982 initiator: MDT0 00010000:00010000:1.0:1767316891.220990:0:82982:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56b04 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 82982 initiator: MDT0 00010000:00010000:1.0:1767316891.220997:0:82982:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56b04 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 82982 initiator: MDT0 00010000:00010000:1.0:1767316891.221011:0:82982:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316891.221017:0:82982:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56b04 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 82982 initiator: MDT0 00010000:00010000:1.0:1767316891.221023:0:82982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56b04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 82982 initiator: MDT0 00000002:00100000:1.0:1767316891.221046:0:82982:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=800002b, status=0 req@ffff9cfe191d9180 x1853163894020608/t8589937397(8589937397) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316891.221057:0:82982:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d9180 x1853163894020608/t8589937397(8589937397) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316891.221074:0:82982:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316891.221154:0:82982:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767316891.221163:0:82982:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316891.221208:0:82982:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 0 00000002:00100000:1.0:1767316891.221226:0:82982:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d9180 x1853163894020608/t8589937397(8589937397) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316891.221263:0:82982:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191d9180 x1853163894020608/t8589937397(8589937397) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316891.221272:0:82982:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316891.221277:0:82982:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3dc00 x1853163894020992/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316891.221299:0:82982:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82982:1853163894020992:192.168.202.121@tcp:35:lfs.0 00000100:00100000:1.0:1767316891.221368:0:82982:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255240 going to sleep for 11 seconds 00000100:00100000:0.0:1767316891.224004:0:82982:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82982:1853163894020992:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316891.224045:0:82982:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191d9180 x1853163894020608/t8589937397(8589937397) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316891.224126:0:82982:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 100001 00000002:00100000:0.0:1767316891.224173:0:82982:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3ca80 x1853163894020352/t8589937396(8589937396) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 536/608 e 0 to 0 dl 1767316907 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316891.224184:0:82982:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316891.224189:0:82982:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9f80 x1853163894021248/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316891.224210:0:82982:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82982:1853163894021248:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316891.224274:0:82982:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316891.231853:0:82982:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82982:1853163894021248:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316891.231892:0:82982:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3ca80 x1853163894020352/t8589937396(8589937396) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 536/608 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767316891.235477:0:82847:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:3.0:1767316891.235504:0:82847:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316891.235563:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82847 initiator: MDT0 00010000:00010000:3.0:1767316891.235573:0:82847:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82847 initiator: MDT0 00010000:00010000:3.0:1767316891.235582:0:82847:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82847 initiator: MDT0 00000100:00100000:3.0:1767316891.235607:0:82847:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894021376:192.168.202.121@tcp:101:bash.0 00000100:00100000:3.0:1767316891.235699:0:82847:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0f1aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1767316891.265215:0:82847:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894021376:192.168.202.121@tcp:101:bash.0 00010000:00010000:3.0:1767316891.265242:0:82847:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.265255:0:82847:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.265267:0:82847:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.265280:0:82847:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.265292:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.265300:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.265308:0:82847:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316891.265319:0:82847:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18fd4380 x1853163894021376/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316891.265333:0:82847:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.265346:0:82847:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1767316891.265353:0:82847:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767316891.265392:0:82847:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:3.0:1767316891.265399:0:82847:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b0b 00000080:00010000:3.0:1767316891.265405:0:82847:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:3.0:1767316891.265408:0:82847:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b0b from it ffffa99f41e27bf8 00010000:00010000:3.0:1767316891.265412:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.265421:0:82847:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316891.265445:0:82847:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:3.0:1767316891.265471:0:82847:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:3.0:1767316891.265486:0:82847:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316891.265495:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.265506:0:82847:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316891.265513:0:82847:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316891.265517:0:82847:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:3.0:1767316891.265520:0:82847:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b0b 00000080:00010000:3.0:1767316891.265523:0:82847:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b0b from it ffffa99f41e27b38 00010000:00010000:3.0:1767316891.265526:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.265533:0:82847:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316891.265541:0:82847:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:3.0:1767316891.265554:0:82847:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), file ffff9cfe0518f800, open_flags 8241, mode 81b6 opened 0 00000080:00200000:3.0:1767316891.265562:0:82847:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open|creat 00000002:00010000:3.0:1767316891.265584:0:82847:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x200000405:0x91:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0101102 00010000:00010000:3.0:1767316891.265597:0:82847:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.265735:0:82847:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.265744:0:82847:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767316891.265746:0:82847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac4fc expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.265782:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82847 initiator: MDT0 00010000:00010000:3.0:1767316891.265790:0:82847:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82847 initiator: MDT0 00000020:00100000:3.0:1767316891.265801:0:82847:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767316891.265809:0:82847:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18fd4380 x1853163894021632/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/67824 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767316891.265818:0:82847:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82847 initiator: MDT0 00000100:00100000:3.0:1767316891.265838:0:82847:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894021632:192.168.202.121@tcp:101:bash.0 00000100:00100000:3.0:1767316891.266010:0:82847:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0f1aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1767316891.273345:0:82847:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894021632:192.168.202.121@tcp:101:bash.0 00010000:00010000:3.0:1767316891.273373:0:82847:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac518 expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.273418:0:82847:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac518 expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.273426:0:82847:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac518 expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.273437:0:82847:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac518 expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.273449:0:82847:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac518 expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.273462:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac518 expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.273470:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac518 expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.273478:0:82847:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac518 expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316891.273489:0:82847:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=2b, status=0 req@ffff9cfe18fd4380 x1853163894021632/t8589937400(8589937400) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767316891.273501:0:82847:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18fd4380 x1853163894021632/t8589937400(8589937400) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316891.273514:0:82847:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac518 expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316891.273536:0:82847:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac518 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.273548:0:82847:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:3.0:1767316891.273554:0:82847:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767316891.273614:0:82847:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x90:0x0](ffff9cfe187d80c8): rc = 0 00000080:00200000:3.0:1767316891.273633:0:82847:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1767316891.273639:0:82847:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b12 00000080:00010000:3.0:1767316891.273650:0:82847:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00200008:3.0:1767316891.273667:0:82847:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 101101 00000002:00100000:3.0:1767316891.274578:0:82847:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18fd4380 x1853163894021632/t8589937400(8589937400) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 880/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1767316891.274616:0:82847:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b12 from it ffff9cfe19077960 00010000:00010000:3.0:1767316891.274622:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac518 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.274632:0:82847:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac518 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316891.274742:0:82847:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 42 00000002:00010000:3.0:1767316891.274773:0:82847:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x90:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1767316891.274815:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b19 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82847 initiator: MDT0 00010000:00010000:3.0:1767316891.274824:0:82847:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b19 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82847 initiator: MDT0 00010000:00010000:3.0:1767316891.274833:0:82847:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b19 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82847 initiator: MDT0 00000100:00100000:3.0:1767316891.274864:0:82847:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894021760:192.168.202.121@tcp:101:bash.0 00000100:00100000:3.0:1767316891.274961:0:82847:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0f1aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1767316891.280025:0:82847:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894021760:192.168.202.121@tcp:101:bash.0 00010000:00010000:3.0:1767316891.280055:0:82847:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b19 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac52d expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.280072:0:82847:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b19 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac52d expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.280125:0:82847:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b19 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac52d expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316891.280142:0:82847:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=80 disposition=0, status=0 req@ffff9cfe18fd5180 x1853163894021760/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 568/1440 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316891.280154:0:82847:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b19 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac52d expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.280170:0:82847:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:3.0:1767316891.280177:0:82847:0:(namei.c:955:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x90:0x0] suppgids 0 -1: rc 0 00000080:00010000:3.0:1767316891.280216:0:82847:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b19 00000080:00010000:3.0:1767316891.280224:0:82847:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b19 from it ffffa99f41e27a48 00010000:00010000:3.0:1767316891.280228:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b19 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac52d expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.280237:0:82847:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b19 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac52d expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1767316891.280294:0:82847:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1767316891.000000000, mtime 1767316891.000000000, ctime 1767316891.000000000 00010000:00010000:3.0:1767316891.280323:0:82847:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac518 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316891.280340:0:82847:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:3.0:1767316891.280381:0:82847:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac518 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.280387:0:82847:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767316891.280390:0:82847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b12 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac518 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000020:00100000:3.0:1767316891.280406:0:82847:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1767316891.280412:0:82847:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18fd5180 x1853163894022016/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767316891.280432:0:82847:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894022016:192.168.202.121@tcp:36:bash.0 00000100:00100000:3.0:1767316891.280502:0:82847:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0f1aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1767316891.286020:0:82847:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894022016:192.168.202.121@tcp:36:bash.0 00000080:00200000:3.0:1767316891.286098:0:82847:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1767316891.286105:0:82847:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:3.0:1767316891.286126:0:82847:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 31 res 8589935621/144 (0 0) 00000080:00010000:3.0:1767316891.286139:0:82847:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000002:00010000:3.0:1767316891.286149:0:82847:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:3.0:1767316891.286198:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82847 initiator: MDT0 00010000:00010000:3.0:1767316891.286229:0:82847:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82847 initiator: MDT0 00010000:00010000:3.0:1767316891.286239:0:82847:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82847 initiator: MDT0 00000100:00100000:3.0:1767316891.286261:0:82847:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894022144:192.168.202.121@tcp:101:bash.0 00000100:00100000:3.0:1767316891.286339:0:82847:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0f1aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1767316891.295918:0:82847:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894022144:192.168.202.121@tcp:101:bash.0 00010000:00010000:3.0:1767316891.295963:0:82847:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac53b expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.295980:0:82847:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac53b expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000002:00100000:3.0:1767316891.295997:0:82847:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe18fd5880 x1853163894022144/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/688 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316891.296020:0:82847:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac53b expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000002:00010000:3.0:1767316891.296035:0:82847:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac53b expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.296047:0:82847:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:3.0:1767316891.296054:0:82847:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1767316891.296072:0:82847:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b20 00000080:00010000:3.0:1767316891.296116:0:82847:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b20 from it ffffa99f41e278c8 00010000:00010000:3.0:1767316891.296121:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac53b expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.296146:0:82847:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac53b expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.296172:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac53b expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.296193:0:82847:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac53b expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000080:00010000:3.0:1767316891.296203:0:82847:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac53b expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316891.296254:0:82847:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1767316891.296259:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac53b expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.296266:0:82847:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac53b expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00020000:00200000:3.0:1767316891.296284:0:82847:0:(lov_io.c:385:lov_io_mirror_init()) [0x200000405:0x90:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1767316891.296305:0:82847:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316891.296309:0:82847:0:(vvp_io.c:356:vvp_io_fini()) [0x200000405:0x90:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1767316891.296318:0:82847:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000002:00010000:3.0:1767316891.296327:0:82847:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 02 00010000:00010000:3.0:1767316891.296342:0:82847:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac53b expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316891.296356:0:82847:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:3.0:1767316891.296397:0:82847:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac53b expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.296404:0:82847:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767316891.296407:0:82847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b20 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac53b expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.296432:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82847 initiator: MDT0 00010000:00010000:3.0:1767316891.296438:0:82847:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82847 initiator: MDT0 00000020:00100000:3.0:1767316891.296951:0:82847:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767316891.296962:0:82847:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18fd5880 x1853163894022400/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/1976 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767316891.296972:0:82847:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82847 initiator: MDT0 00000100:00100000:3.0:1767316891.297000:0:82847:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894022400:192.168.202.121@tcp:101:bash.0 00000100:00100000:3.0:1767316891.297120:0:82847:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0f1aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1767316891.310799:0:82847:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937403 gen 1 00000100:00100000:3.0:1767316891.311148:0:82847:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe18fd4380 x1853163894021632/t8589937400(8589937400) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 880/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1767316891.311172:0:82847:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894022400:192.168.202.121@tcp:101:bash.0 00010000:00010000:3.0:1767316891.311199:0:82847:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.311211:0:82847:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 4/0,1 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.311235:0:82847:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.311246:0:82847:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.311260:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.311267:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.311274:0:82847:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000002:00100000:3.0:1767316891.311284:0:82847:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe18fd5880 x1853163894022400/t8589937403(8589937403) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/688 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316891.311574:0:82847:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000002:00010000:2.0:1767316891.311949:0:82847:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316891.311964:0:82847:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:2.0:1767316891.311971:0:82847:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1767316891.311985:0:82847:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b27 00000080:00010000:2.0:1767316891.312001:0:82847:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b27 from it ffffa99f41e27930 00010000:00010000:2.0:1767316891.312005:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316891.312013:0:82847:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316891.312031:0:82847:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1767316891.312037:0:82847:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:2.0:1767316891.312053:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316891.312064:0:82847:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1767316891.312073:0:82847:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316891.312144:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316891.312152:0:82847:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316891.312166:0:82847:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767316891.312176:0:82847:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316891.312179:0:82847:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767316891.312191:0:82847:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316891.312221:0:82847:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1767316891.312234:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316891.312249:0:82847:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1767316891.312257:0:82847:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316891.312274:0:82847:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:2.0:1767316891.312279:0:82847:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316891.312282:0:82847:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767316891.312284:0:82847:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316891.312293:0:82847:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316891.312370:0:82847:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:2.0:1767316891.312375:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316891.314479:0:82847:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00020000:00200000:2.0:1767316891.314504:0:82847:0:(lov_io.c:308:lov_io_mirror_write_intent()) [0x200000405:0x90:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:2.0:1767316891.314509:0:82847:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316891.314511:0:82847:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767316891.314523:0:82847:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316891.314539:0:82847:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1767316891.314553:0:82847:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1767316891.314558:0:82847:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f730, osc lock ffff9cfe2013ce40, flags 0x80000000 00010000:00010000:2.0:1767316891.314612:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316891.314642:0:82847:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316891.314653:0:82847:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767316891.314684:0:82847:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910ad80 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894022528:192.168.202.121@tcp:101:bash.0 00000100:00100000:2.0:1767316891.314775:0:82847:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe190a8600 going to sleep for 11 seconds 00000100:00100000:3.0:1767316891.317569:0:82847:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910ad80 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894022528:192.168.202.121@tcp:101:bash.0 00010000:00010000:3.0:1767316891.317610:0:82847:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316891.317626:0:82847:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316891.317659:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767316891.317672:0:82847:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316891.317755:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316891.317764:0:82847:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767316891.320612:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894022656:192.168.202.121@tcp:10:bash.0 00000100:00100000:2.0:1767316891.323710:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894022656:192.168.202.121@tcp:10:bash.0 00000080:00200000:1.0:1767316891.323800:0:82847:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1767316891.323822:0:82847:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.323825:0:82847:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.323830:0:82847:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f730 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767316891.323841:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.323854:0:82847:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767316891.323870:0:82847:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.323874:0:82847:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f730 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.323894:0:82847:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316891.323906:0:82847:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8) current size 0, valid attrs a168, mode 0, uid 2, gid 0, new size 0, atime 1767316891.000000000, mtime 1767316891.000000000, ctime 1767316891.000000000, rc 0 00000080:00200008:1.0:1767316891.324035:0:82847:0:(file.c:2648:do_file_write_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:1.0:1767316891.324049:0:82847:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 29 bytes 00000080:00200000:1.0:1767316891.324056:0:82847:0:(file.c:2624:ll_do_tiny_write()) result: 0, original count 29 00000080:00200000:1.0:1767316891.324061:0:82847:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: write ppos: 0, bytes: 29 00000080:00200000:1.0:1767316891.324066:0:82847:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 0 00000020:00200000:1.0:1767316891.324073:0:82847:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 1, [0x200000405:0x90:0x0] hash] 00000020:00200000:1.0:1767316891.324075:0:82847:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 29) 0 0 00000080:00200000:1.0:1767316891.324103:0:82847:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:1.0:1767316891.324117:0:82847:0:(lov_io.c:308:lov_io_mirror_write_intent()) [0x200000405:0x90:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 2 00020000:00200000:1.0:1767316891.324122:0:82847:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.324125:0:82847:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:1.0:1767316891.324130:0:82847:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1767316891.324137:0:82847:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:1.0:1767316891.324140:0:82847:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316891.324155:0:82847:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1767316891.324174:0:82847:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767316891.324179:0:82847:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d799b0, osc lock ffff9cfe09c74130, flags 0x0 00010000:00010000:1.0:1767316891.324285:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.324298:0:82847:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.324311:0:82847:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 6/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.324319:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 6/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.324326:0:82847:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316891.324337:0:82847:0:(vvp_io.c:1312:vvp_io_write_start()) f212b.sanity-flr: write [0, 29) append 0 append lockpos 0 00000080:00200000:1.0:1767316891.324347:0:82847:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 29 bytes 00000080:00200000:1.0:1767316891.324390:0:82847:0:(rw26.c:912:ll_write_end()) pos 0, len 29, copied 29 00000080:00200000:1.0:1767316891.324396:0:82847:0:(rw26.c:969:ll_write_end()) page@00000000dfaec3cf[3 0000000093b559bf 2 1 000000008fc9b4a6] 00000080:00200000:1.0:1767316891.324399:0:82847:0:(rw26.c:969:ll_write_end()) vmpage @00000000ccf4b311 17ffffc0001001 3:0 ffff9cfe028d2438 0 lru 00000080:00200000:1.0:1767316891.324404:0:82847:0:(rw26.c:969:ll_write_end()) osc-page@00000000073934ae 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000f9009730 00000000c15b0ab9 > 3< 0 0 > 4< 0 0 8 484638720 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1767316891.324406:0:82847:0:(rw26.c:969:ll_write_end()) end page@00000000dfaec3cf 00000080:00200000:1.0:1767316891.324407:0:82847:0:(rw26.c:969:ll_write_end()) queued page: 1. 00000080:00200000:1.0:1767316891.324410:0:82847:0:(vvp_io.c:1193:vvp_io_write_commit()) commit async pages: 1, from 0, to 29 prio 0 00000008:00010000:1.0:1767316891.324426:0:82847:0:(osc_cache.c:814:osc_extent_find()) ### extent: 000000000bb2c823 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316891.324441:0:82847:0:(vvp_io.c:1106:vvp_set_batch_dirty()) mapping ffff9cfe187d8278, count 1, dirtied 1 00000080:00200000:1.0:1767316891.324450:0:82847:0:(vvp_io.c:1216:vvp_io_write_commit()) Committed 1 pages 29 bytes, tot: 29 00000080:00200000:1.0:1767316891.324453:0:82847:0:(vvp_io.c:1390:vvp_io_write_start()) f212b.sanity-flr: write bytes 0, result: 29 00000020:00010000:1.0:1767316891.324467:0:82847:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.324469:0:82847:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.324472:0:82847:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d799b0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767316891.324476:0:82847:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.324484:0:82847:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767316891.324493:0:82847:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.324495:0:82847:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d799b0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.324501:0:82847:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000080:00200000:1.0:1767316891.324505:0:82847:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1767316891.324510:0:82847:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316891.324514:0:82847:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 2 io complete with rc: 0, result: 29, restart: 0 00000080:00200000:1.0:1767316891.324519:0:82847:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 0 00000080:00200000:1.0:1767316891.324521:0:82847:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 29 00000080:00200008:1.0:1767316891.324537:0:82847:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 100001 00000002:00100000:1.0:1767316891.324584:0:82847:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18fd4380 x1853163894021632/t8589937400(8589937400) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 880/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316891.324593:0:82847:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316891.324596:0:82847:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c000 x1853163894022912/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316891.324774:0:82847:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894022912:192.168.202.121@tcp:35:bash.0 00000100:00100000:1.0:1767316891.324864:0:82847:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:1.0:1767316891.330581:0:82847:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:82847:1853163894022912:192.168.202.121@tcp:35:bash.0 00000002:00100000:1.0:1767316891.330794:0:82847:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18fd4380 x1853163894021632/t8589937400(8589937400) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 880/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316891.348075:0:82992:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316891.348372:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316891.348534:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 82992 initiator: MDT0 00010000:00010000:0.0:1767316891.348547:0:82992:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00010000:00010000:0.0:1767316891.348560:0:82992:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00000100:00100000:0.0:1767316891.348594:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894023040:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316891.348704:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316891.353284:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894023040:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316891.353312:0:82992:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.353326:0:82992:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.353337:0:82992:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.353348:0:82992:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.353360:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.353374:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.353381:0:82992:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316891.353391:0:82992:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191da680 x1853163894023040/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316891.353403:0:82992:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.353435:0:82992:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316891.353442:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316891.353469:0:82992:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316891.353476:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:1.0:1767316891.353482:0:82992:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316891.353485:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f414ebb58 00010000:00010000:1.0:1767316891.353488:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.353497:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.353521:0:82992:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316891.353541:0:82992:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=9 00000080:00200000:1.0:1767316891.353546:0:82992:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316891.353584:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.353630:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82992 initiator: MDT0 00010000:00010000:1.0:1767316891.353636:0:82992:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00010000:00010000:1.0:1767316891.353645:0:82992:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00000100:00100000:1.0:1767316891.353665:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894023168:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316891.353825:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:1.0:1767316891.358212:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894023168:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316891.358254:0:82992:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.358273:0:82992:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.358280:0:82992:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.358303:0:82992:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.358314:0:82992:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.358325:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.358334:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.358341:0:82992:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316891.358353:0:82992:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c000 x1853163894023168/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/928 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316891.358364:0:82992:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316891.358387:0:82992:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.358399:0:82992:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316891.358405:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316891.358470:0:82992:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x90:0x0](ffff9cfe187d80c8): rc = 0 00000080:00200000:1.0:1767316891.358486:0:82992:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1767316891.358491:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b3c 00000080:00010000:1.0:1767316891.358501:0:82992:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316891.358505:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b3c from it ffffa99f414ebb20 00010000:00010000:1.0:1767316891.358508:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.358517:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767316891.358551:0:82992:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316891.358559:0:82992:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316891.358579:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.358587:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.358602:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.358609:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316891.358614:0:82992:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316891.358621:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b3c 00000080:00010000:1.0:1767316891.358626:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b3c from it ffffa99f414ebcb8 00010000:00010000:1.0:1767316891.358629:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.358635:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.359070:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1767316891.359172:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.359176:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316891.359190:0:82992:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767316891.359211:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316891.359215:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d799b0, osc lock ffff9cfe09c74130, flags 0x400000400001002 00010000:00010000:1.0:1767316891.359232:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.359242:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.359258:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316891.359261:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.359269:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.359279:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316891.359295:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 0 00000020:00010000:1.0:1767316891.359301:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.359305:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.359308:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d799b0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.359312:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.359315:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d799b0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.359544:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316891.359583:0:82992:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316891.359592:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.359598:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.359604:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.359608:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316891.359611:0:82992:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316891.359613:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:1.0:1767316891.359616:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f414ebbf8 00010000:00010000:1.0:1767316891.359618:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.359622:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.359627:0:82992:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316891.359632:0:82992:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:1.0:1767316891.359635:0:82992:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 46 00000080:00200008:1.0:1767316891.359643:0:82992:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 154402 00000002:00010000:1.0:1767316891.359663:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114403 00010000:00010000:1.0:1767316891.359775:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82992 initiator: MDT0 00010000:00010000:1.0:1767316891.359780:0:82992:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00000020:00100000:1.0:1767316891.359788:0:82992:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316891.359795:0:82992:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c000 x1853163894023424/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316891.359869:0:82992:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00000100:00100000:1.0:1767316891.359977:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894023424:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316891.360448:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:2.0:1767316891.364312:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316891.364408:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939792512 00000100:00100000:3.0:1767316891.364418:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939792512 00000100:00100000:3.0:1767316891.364505:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10200 00000100:00100000:3.0:1767316891.364515:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939792512:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316891.364534:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316891.364618:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316891.364625:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939792512:12345-192.168.202.121@tcp:104: Request processed in 112us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316891.364633:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10200 00010000:00010000:0.0:1767316891.364684:0:42048:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316891.364692:0:42048:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.364700:0:42048:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2dc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316891.364705:0:42048:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.364713:0:42048:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.364720:0:42048:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.364746:0:42048:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.364783:0:42048:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.364789:0:42048:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316891.364824:0:42048:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.364831:0:42048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56b3c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac57a expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.364846:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316891.364848:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316891.364850:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316891.364858:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316891.364885:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894023552:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316891.370013:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894023552:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316891.372037:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894023424:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316891.372066:0:82992:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.372535:0:82992:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.372545:0:82992:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.372557:0:82992:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.372569:0:82992:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.372599:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.372606:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.372613:0:82992:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316891.372624:0:82992:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe18f3c000 x1853163894023424/t8589937405(8589937405) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316891.372636:0:82992:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3c000 x1853163894023424/t8589937405(8589937405) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316891.372664:0:82992:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.372675:0:82992:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 8 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316891.372681:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316891.372732:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b43 00000080:00010000:1.0:1767316891.372739:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b43 from it ffffa99f414ebbf0 00010000:00010000:1.0:1767316891.372743:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.372751:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316891.372783:0:82992:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3c000 x1853163894023424/t8589937405(8589937405) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316891.372951:0:82992:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1767316891.372961:0:82992:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), xattr lov 00000080:00200008:1.0:1767316891.373004:0:82992:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316891.373013:0:82992:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316891.373029:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.373851:0:82992:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:1.0:1767316891.373901:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82992 initiator: MDT0 00010000:00010000:1.0:1767316891.373909:0:82992:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00010000:00010000:1.0:1767316891.373918:0:82992:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00000100:00100000:1.0:1767316891.373949:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894023680:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316891.374265:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:3.0:1767316891.378372:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316891.378551:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939792640 00000100:00100000:2.0:1767316891.378562:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939792640 00000100:00100000:2.0:1767316891.378662:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10201 00000100:00100000:2.0:1767316891.378673:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939792640:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316891.378701:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316891.378777:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316891.378786:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939792640:12345-192.168.202.121@tcp:104: Request processed in 115us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316891.378793:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10201 00010000:00010000:0.0:1767316891.378850:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316891.378858:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.378866:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316891.378871:0:63142:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.378880:0:63142:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.378888:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.378956:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.378963:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316891.379004:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 1/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.379012:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56b43 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac588 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.379027:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316891.379029:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316891.379030:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316891.379053:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316891.379070:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894023808:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316891.384939:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894023680:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316891.384971:0:82992:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac59d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.384986:0:82992:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac59d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.385000:0:82992:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac59d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.385019:0:82992:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac59d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.385050:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac59d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.385058:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac59d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.385066:0:82992:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac59d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316891.385125:0:82992:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3d880 x1853163894023680/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/928 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316891.385138:0:82992:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac59d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316891.385151:0:82992:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac59d expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.385163:0:82992:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316891.385169:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316891.385425:0:82992:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1767316891.385432:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b4a 00000080:00010000:1.0:1767316891.385437:0:82992:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316891.385440:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b4a from it ffffa99f414ebcd8 00010000:00010000:1.0:1767316891.385444:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac59d expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.385451:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac59d expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.385495:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1767316891.385508:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.385511:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316891.385515:0:82992:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767316891.385531:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316891.385534:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d799b0, osc lock ffff9cfe09c74130, flags 0x400000400001002 00010000:00010000:1.0:1767316891.385550:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.385563:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.385576:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316891.385581:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.385588:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.385597:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316891.385608:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 0 00000020:00010000:1.0:1767316891.385613:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.385616:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.385619:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d799b0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.385622:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.385625:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d799b0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.385633:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:1.0:1767316891.385695:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=c00c66f3 arg=189a2a0 00000002:00010000:1.0:1767316891.385716:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 05004040000002 00010000:00010000:1.0:1767316891.385762:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56b51 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82992 initiator: MDT0 00010000:00010000:1.0:1767316891.385769:0:82992:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56b51 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00000020:00100000:1.0:1767316891.385779:0:82992:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316891.385785:0:82992:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3d880 x1853163894024064/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316891.385793:0:82992:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56b51 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x81000000000000 pid: 82992 initiator: MDT0 00000100:00100000:1.0:1767316891.385813:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894024064:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316891.386194:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894023808:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316891.386500:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:1.0:1767316891.391543:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894024064:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316891.391577:0:82992:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56b51 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac5ab expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.391590:0:82992:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56b51 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac5ab expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.391605:0:82992:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56b51 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac5ab expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.391616:0:82992:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56b51 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac5ab expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.391652:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56b51 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac5ab expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.391661:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56b51 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac5ab expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.391668:0:82992:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56b51 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac5ab expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316891.391690:0:82992:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff9cfe18f3d880 x1853163894024064/t8589937406(8589937406) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316891.391704:0:82992:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3d880 x1853163894024064/t8589937406(8589937406) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316891.391721:0:82992:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56b51 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac5ab expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.391736:0:82992:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 2 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316891.391744:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1767316891.391764:0:82992:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3d880 x1853163894024064/t8589937406(8589937406) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767316891.391771:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b51 00000080:00010000:1.0:1767316891.391778:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b51 from it ffffa99f414ebcc0 00010000:00010000:1.0:1767316891.391782:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56b51 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac5ab expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.391788:0:82992:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56b51 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac5ab expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.392401:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:1.0:1767316891.392413:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.392416:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316891.392422:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:1.0:1767316891.392482:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316891.392497:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894024192:192.168.202.121@tcp:1:lfs.0 00000100:00100000:2.0:1767316891.396179:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316891.396426:0:42041:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767316891.396458:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939792768 00000100:00100000:3.0:1767316891.396468:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939792768 00000100:00100000:3.0:1767316891.396523:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10202 00000100:00100000:3.0:1767316891.396532:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe28138850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:48911:x1853163939792768:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316891.396549:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316891.396630:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316891.396638:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe28138850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:48911:x1853163939792768:12345-192.168.202.121@tcp:104: Request processed in 107us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316891.396645:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10202 00010000:00010000:0.0:1767316891.396752:0:63296:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316891.396759:0:63296:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420080000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.396767:0:63296:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05094600 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316891.396773:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428480000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316891.396797:0:63296:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### extent: 000000000bb2c823 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316891.396812:0:63296:0:(osc_cache.c:1103:osc_extent_make_ready()) ### extent: 000000000bb2c823 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.396862:0:63296:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000008:00100000:0.0:1767316891.396941:0:63296:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe191d8e00 - object 0x280000400:162 offset 0<>29 00000100:00100000:0.0:1767316891.396997:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894024320:192.168.202.121@tcp:4:bash.0 00000008:00010000:0.0:1767316891.404047:0:2503:0:(osc_cache.c:861:osc_extent_finish()) ### extent: 000000000bb2c823 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316891.404153:0:2503:0:(osc_cache.c:483:__osc_extent_remove()) ### extent: 000000000bb2c823 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800429480000000 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316891.404188:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894024320:192.168.202.121@tcp:4:bash.0 00000080:00200000:2.0:1767316891.404341:0:63296:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767316891.404396:0:63296:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1767316891.404445:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480000020 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316891.404453:0:63296:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767316891.404475:0:63296:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480000020 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316891.404483:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56b2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480000020 nid: local remote: 0x863eb2f6655ac550 expref: -99 pid: 82847 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316891.404504:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316891.404506:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316891.404508:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316891.404520:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894024448:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316891.409645:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894024448:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316891.409968:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894024192:192.168.202.121@tcp:1:lfs.0 00010000:00010000:1.0:1767316891.410266:0:82992:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.410294:0:82992:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:1.0:1767316891.410314:0:82992:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac59d expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.410324:0:82992:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:1.0:1767316891.410366:0:82992:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.410372:0:82992:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac59d expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.410376:0:82992:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316891.410378:0:82992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad56b27 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac549 expref: -99 pid: 82847 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.410388:0:82992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b4a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac59d expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767316891.410400:0:82992:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316891.410420:0:82992:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f100 x1853163894024704/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316891.410463:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894024704:192.168.202.121@tcp:36:lfs.0 00000100:00100000:1.0:1767316891.410546:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:1.0:1767316891.422529:0:82992:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937407 gen 1 00000100:00100000:1.0:1767316891.422548:0:82992:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe18f3c000 x1853163894023424/t8589937405(8589937405) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767316891.422563:0:82992:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe18f3d880 x1853163894024064/t8589937406(8589937406) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767316891.422573:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894024704:192.168.202.121@tcp:36:lfs.0 00010000:00010000:1.0:1767316891.422622:0:82992:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 31 res 8589935621/144 (0 0) 00000080:00010000:1.0:1767316891.422636:0:82992:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000002:00010000:1.0:1767316891.422647:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:1.0:1767316891.422764:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 82992 initiator: MDT0 00010000:00010000:1.0:1767316891.422773:0:82992:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00010000:00010000:1.0:1767316891.422783:0:82992:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00000100:00100000:1.0:1767316891.422804:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894024832:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316891.422882:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:1.0:1767316891.424949:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894024832:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316891.424977:0:82992:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.425008:0:82992:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767316891.425023:0:82992:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe18f3f100 x1853163894024832/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/688 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316891.425034:0:82992:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767316891.425044:0:82992:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.425054:0:82992:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316891.425059:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316891.425073:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b58 00000080:00010000:1.0:1767316891.425226:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b58 from it ffffa99f414ebc70 00010000:00010000:1.0:1767316891.425231:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.425240:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.425264:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.425275:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767316891.425284:0:82992:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.425411:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.425419:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.425436:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 6 restore needed 0 00020000:00200000:1.0:1767316891.425448:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.425452:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316891.425459:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316891.425490:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1767316891.425504:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.425513:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767316891.425520:0:82992:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.425536:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:1.0:1767316891.425541:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.425543:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316891.425545:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316891.425553:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316891.425626:0:82992:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 5 00010000:00010000:1.0:1767316891.425631:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.425645:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200080:1.0:1767316891.425671:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=66f4 arg=ffffffffffffffff 00000080:00200008:1.0:1767316891.425759:0:82992:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316891.425768:0:82992:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316891.425781:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.425788:0:82992:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:1.0:1767316891.425823:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82992 initiator: MDT0 00010000:00010000:1.0:1767316891.425829:0:82992:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00010000:00010000:1.0:1767316891.425838:0:82992:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00000100:00100000:1.0:1767316891.425860:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894024960:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316891.425944:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:1.0:1767316891.429376:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894024960:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316891.429403:0:82992:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.429415:0:82992:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.429426:0:82992:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.429453:0:82992:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.429465:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.429472:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.429479:0:82992:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316891.429489:0:82992:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3f100 x1853163894024960/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/928 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316891.429501:0:82992:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316891.429515:0:82992:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.429527:0:82992:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316891.429533:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316891.429590:0:82992:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 5 -> 5 00000080:00010000:1.0:1767316891.429596:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b5f 00000080:00010000:1.0:1767316891.429602:0:82992:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316891.429604:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b5f from it ffffa99f414ebcd8 00010000:00010000:1.0:1767316891.429607:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.429624:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.429746:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1767316891.429757:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.429760:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316891.429764:0:82992:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767316891.429779:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316891.429782:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x400000400001002 00010000:00010000:1.0:1767316891.429828:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.429836:0:82992:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.429846:0:82992:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe18f3f100 x1853163894025088/t0(0) o101->lustre-OST0001-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316891.429934:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894025088:192.168.202.121@tcp:101:lfs.0 00000020:00200000:1.0:1767316891.430575:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316891.434777:0:2502:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.434807:0:2502:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.434822:0:2502:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.434835:0:2502:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316891.434851:0:2502:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316891.434865:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767316891.434885:0:2502:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.434894:0:2502:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.434938:0:2502:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.434948:0:2502:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316891.434970:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894025088:192.168.202.121@tcp:101:lfs.0 00000080:00200000:1.0:1767316891.435156:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767316891.435164:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.435167:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.435172:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.435177:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.435179:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.435193:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:1.0:1767316891.478276:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=1 00000080:00200008:1.0:1767316891.478377:0:82992:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316891.478396:0:82992:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316891.478416:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.478433:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.478523:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.478532:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316891.478541:0:82992:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316891.478544:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b5f 00000080:00010000:1.0:1767316891.478552:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b5f from it ffffa99f414ebcd8 00010000:00010000:1.0:1767316891.478555:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.478564:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.478591:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1767316891.478603:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.478605:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316891.478609:0:82992:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767316891.478627:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316891.478631:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x400000400001002 00010000:00010000:1.0:1767316891.478647:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.478658:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.478680:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316891.478684:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.478692:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.478702:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316891.478712:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767316891.478716:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.478719:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.478723:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.478727:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.478730:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.478740:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316891.478754:0:82992:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:1.0:1767316891.478759:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767316891.478763:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.478765:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316891.478769:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316891.478784:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000080:00200000:1.0:1767316891.478792:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316891.478888:0:82992:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000080:00200000:1.0:1767316891.478893:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316891.478899:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316891.478905:0:82992:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:1.0:1767316891.478920:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:1.0:1767316891.478923:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x0 00010000:00010000:1.0:1767316891.478941:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.478950:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.478959:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.478965:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.478972:0:82992:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316891.478982:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000100:00100000:0.0:1767316891.479187:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894025216:192.168.202.121@tcp:23:lfs.0 00000100:00100000:0.0:1767316891.488451:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894025216:192.168.202.121@tcp:23:lfs.0 00000020:00010000:1.0:1767316891.488582:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.488587:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.488592:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767316891.488603:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.488617:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767316891.488632:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.488652:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.488668:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316891.488742:0:82992:0:(file.c:5216:ll_file_seek()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:1.0:1767316891.488753:0:82992:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:1.0:1767316891.488762:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767316891.488770:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.488773:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316891.488779:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316891.488876:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000080:00200000:1.0:1767316891.488883:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316891.488889:0:82992:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000080:00200000:1.0:1767316891.488891:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316891.488896:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316891.488901:0:82992:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:1.0:1767316891.488914:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:1.0:1767316891.488917:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x0 00010000:00010000:1.0:1767316891.488944:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.488958:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.488970:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.488978:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.488997:0:82992:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316891.489107:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000100:00100000:0.0:1767316891.489409:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894025344:192.168.202.121@tcp:23:lfs.0 00000100:00100000:0.0:1767316891.492989:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894025344:192.168.202.121@tcp:23:lfs.0 00000020:00010000:1.0:1767316891.493150:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.493155:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.493161:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767316891.493170:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.493183:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767316891.493199:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.493202:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.493218:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316891.493229:0:82992:0:(file.c:5216:ll_file_seek()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_HOLE, rc = 29 00000080:00200080:1.0:1767316891.493243:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:1.0:1767316891.493252:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=1 00000080:00200008:1.0:1767316891.493258:0:82992:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316891.493266:0:82992:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316891.493360:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.493377:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.493408:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.493417:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316891.493423:0:82992:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316891.493427:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b5f 00000080:00010000:1.0:1767316891.493432:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b5f from it ffffa99f414ebcd8 00010000:00010000:1.0:1767316891.493435:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.493514:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.493534:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1767316891.493544:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.493547:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316891.493551:0:82992:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767316891.493567:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316891.493571:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x400000400001002 00010000:00010000:1.0:1767316891.493585:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.493595:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.493606:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316891.493609:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.493623:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.493633:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316891.493643:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767316891.493647:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.493649:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.493652:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.493655:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.493657:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.493663:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316891.493751:0:82992:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 4096 00000080:00200000:1.0:1767316891.493757:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767316891.493761:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.493764:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:1.0:1767316891.493768:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316891.493773:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1767316891.493777:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.493779:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316891.493781:0:82992:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767316891.493788:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316891.493790:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x400000400001002 00010000:00010000:1.0:1767316891.493879:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.493890:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.493904:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316891.493907:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.493914:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.493923:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316891.493937:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767316891.493940:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.493942:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.493945:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8b48/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.493947:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b0490 (ffff9cfe0e436f38/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.493950:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.493955:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316891.493959:0:82992:0:(file.c:2367:file_read_confine_iter()) f212b.sanity-flr: read [0, 4096] over eof, kms 29, file_size 29. 00000080:00200000:1.0:1767316891.493967:0:82992:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:1.0:1767316891.493973:0:82992:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000020:00200000:1.0:1767316891.493980:0:82992:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:1.0:1767316891.493981:0:82992:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:1.0:1767316891.493984:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:1.0:1767316891.493991:0:82992:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1767316891.493998:0:82992:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:1.0:1767316891.494001:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316891.494179:0:82992:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:1.0:1767316891.494189:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:1.0:1767316891.494192:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x40000 00000080:00200000:1.0:1767316891.494197:0:82992:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:1.0:1767316891.494211:0:82992:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:1.0:1767316891.494217:0:82992:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:1.0:1767316891.494269:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1767316891.494272:0:82992:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:1.0:1767316891.494277:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.494280:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.494282:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.494285:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.494364:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.494369:0:82992:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:1.0:1767316891.494374:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:1.0:1767316891.494397:0:75366:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe04db6900 00000008:00100000:1.0:1767316891.494436:0:75366:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe18f3e300 - object 0x280000400:162 offset 0<>29 00000100:00100000:0.0:1767316891.494567:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894025472:192.168.202.121@tcp:3:lfs.0 00000008:00010000:0.0:1767316891.499013:0:2503:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe04db6900 00000020:00200000:0.0:1767316891.499025:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1767316891.499033:0:2503:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:0.0:1767316891.499041:0:2503:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:0.0:1767316891.499063:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767316891.499115:0:2503:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe04db6900 00000080:00200000:1.0:1767316891.499128:0:82992:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000100:00100000:0.0:1767316891.499142:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894025472:192.168.202.121@tcp:3:lfs.0 00000080:00200000:1.0:1767316891.499145:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316891.499153:0:82992:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:1.0:1767316891.499156:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316891.499165:0:82992:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:1.0:1767316891.499231:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:1.0:1767316891.499244:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=2 00000080:00200008:1.0:1767316891.499251:0:82992:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316891.499259:0:82992:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316891.499279:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.499364:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.499378:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.499387:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316891.499409:0:82992:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316891.499413:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b5f 00000080:00010000:1.0:1767316891.499421:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b5f from it ffffa99f414ebcd8 00010000:00010000:1.0:1767316891.499425:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.499434:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.499527:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1767316891.499538:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.499540:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316891.499544:0:82992:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767316891.499559:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316891.499562:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x400000400001002 00010000:00010000:1.0:1767316891.499576:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.499586:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.499597:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316891.499600:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.499607:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.499616:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316891.499632:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767316891.499636:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.499639:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.499642:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.499647:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.499649:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.499656:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316891.499685:0:82992:0:(file.c:2648:do_file_write_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 4096 00000080:00200000:1.0:1767316891.499692:0:82992:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:1.0:1767316891.499700:0:82992:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:1.0:1767316891.499706:0:82992:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:1.0:1767316891.499708:0:82992:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:1.0:1767316891.499711:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:1.0:1767316891.499721:0:82992:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1767316891.499727:0:82992:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:1.0:1767316891.499731:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:1.0:1767316891.499741:0:82992:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1767316891.499749:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:1.0:1767316891.499752:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x40000 00000080:00200000:1.0:1767316891.499760:0:82992:0:(vvp_io.c:1312:vvp_io_write_start()) f212b.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000080:00200000:1.0:1767316891.499784:0:82992:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:1.0:1767316891.499937:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1767316891.499941:0:82992:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:1.0:1767316891.499950:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767316891.499953:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.499956:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.499959:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.499962:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.499964:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.499970:0:82992:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:1.0:1767316891.499983:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:1.0:1767316891.499998:0:75366:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe04db6840 00000008:00100000:1.0:1767316891.500641:0:75366:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe18f3f800 - object 0x2c0000400:161 offset 0<>4096 00000100:00100000:0.0:1767316891.500761:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316891.500783:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894025600:192.168.202.121@tcp:4:lfs.0 00000100:00100000:0.0:1767316891.510448:0:2503:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff9cfe08c17800: committing for last_committed 25769805129 gen 1 00000008:00010000:0.0:1767316891.510492:0:2503:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe04db6840 00000020:00200000:0.0:1767316891.510499:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1767316891.510508:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767316891.510518:0:2503:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe04db6840 00000100:00100000:0.0:1767316891.510541:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894025600:192.168.202.121@tcp:4:lfs.0 00000080:00200000:1.0:1767316891.510811:0:82992:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1767316891.510823:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316891.510826:0:82992:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:1.0:1767316891.510835:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00200000:1.0:1767316891.510838:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316891.510844:0:82992:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:1.0:1767316891.510858:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:1.0:1767316891.510867:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=3 00000080:00200008:1.0:1767316891.510872:0:82992:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316891.510878:0:82992:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316891.510897:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.510914:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.510937:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.510945:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316891.510951:0:82992:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316891.510955:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b5f 00000080:00010000:1.0:1767316891.510963:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b5f from it ffffa99f414ebcd8 00010000:00010000:1.0:1767316891.510967:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.510976:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.511012:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1767316891.511023:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.511026:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316891.511029:0:82992:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767316891.511048:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316891.511052:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x400000400001002 00010000:00010000:1.0:1767316891.511068:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.511106:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.511119:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316891.511122:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.511129:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.511139:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316891.511145:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767316891.511148:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.511151:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.511155:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.511159:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.511162:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.511169:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316891.511184:0:82992:0:(file.c:2648:do_file_write_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 4096 00000080:00200000:1.0:1767316891.511190:0:82992:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:1.0:1767316891.511197:0:82992:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 3 00000020:00200000:1.0:1767316891.511204:0:82992:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:1.0:1767316891.511206:0:82992:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:1.0:1767316891.511208:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:1.0:1767316891.511217:0:82992:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1767316891.511223:0:82992:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:1.0:1767316891.511227:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:1.0:1767316891.511239:0:82992:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1767316891.511245:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:1.0:1767316891.511247:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x40000 00000080:00200000:1.0:1767316891.511252:0:82992:0:(vvp_io.c:1312:vvp_io_write_start()) f212b.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000080:00200000:1.0:1767316891.511262:0:82992:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:1.0:1767316891.511307:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1767316891.511309:0:82992:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:1.0:1767316891.511315:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767316891.511317:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.511319:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.511321:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.511322:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.511324:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.511327:0:82992:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:1.0:1767316891.511332:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:1.0:1767316891.511343:0:75366:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe04db6840 00000008:00100000:1.0:1767316891.511404:0:75366:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe18f3c700 - object 0x280000400:163 offset 0<>4096 00000100:00100000:0.0:1767316891.511969:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894025728:192.168.202.121@tcp:4:lfs.0 00000100:00100000:0.0:1767316891.525885:0:2503:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9cfe08c17800: committing for last_committed 17179875401 gen 1 00000008:00010000:0.0:1767316891.525956:0:2503:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe04db6840 00000020:00200000:0.0:1767316891.525963:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1767316891.525971:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767316891.525994:0:2503:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe04db6840 00000100:00100000:0.0:1767316891.526025:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894025728:192.168.202.121@tcp:4:lfs.0 00000080:00200000:1.0:1767316891.526053:0:82992:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1767316891.526066:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316891.526071:0:82992:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:1.0:1767316891.526227:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00200000:1.0:1767316891.526245:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316891.526253:0:82992:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:1.0:1767316891.526271:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:1.0:1767316891.526278:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=1 00000080:00200008:1.0:1767316891.526285:0:82992:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316891.526367:0:82992:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316891.526389:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.526406:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.526419:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.526427:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316891.526433:0:82992:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316891.526437:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b5f 00000080:00010000:1.0:1767316891.526566:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b5f from it ffffa99f414ebcd8 00010000:00010000:1.0:1767316891.526570:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.526578:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.526600:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1767316891.526614:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.526616:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316891.526621:0:82992:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767316891.526646:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316891.526650:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x400000400001002 00010000:00010000:1.0:1767316891.526670:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.526679:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.526689:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316891.526692:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.526700:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.526710:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316891.526716:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767316891.526720:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.526723:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.526726:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.526730:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.526733:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.526741:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316891.526751:0:82992:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 29, type: SEEK_DATA 00000080:00200000:1.0:1767316891.526755:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767316891.526759:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.526762:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316891.526765:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316891.526781:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000080:00200000:1.0:1767316891.526787:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316891.527378:0:82992:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000080:00200000:1.0:1767316891.527383:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316891.527389:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316891.527392:0:82992:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:1.0:1767316891.527399:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:1.0:1767316891.527401:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x0 00010000:00010000:1.0:1767316891.527409:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.527418:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.527428:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.527435:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.527452:0:82992:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316891.527464:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767316891.527468:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.527471:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.527473:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767316891.527477:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.527496:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767316891.527505:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.527507:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.527521:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316891.527528:0:82992:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: (null) 00000080:00200000:1.0:1767316891.527531:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1767316891.527535:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.527536:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316891.527538:0:82992:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767316891.527542:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316891.527544:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x400000400001002 00010000:00010000:1.0:1767316891.527549:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.527555:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.527561:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316891.527563:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.527567:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.527580:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316891.527584:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767316891.527585:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.527587:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.527588:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.527590:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.527591:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.527595:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316891.527599:0:82992:0:(file.c:5216:ll_file_seek()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: (null), rc = 29 00000080:00200080:1.0:1767316891.527604:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:1.0:1767316891.544312:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=2 00000080:00200008:1.0:1767316891.544334:0:82992:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316891.544342:0:82992:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316891.544367:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.544384:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.544396:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.544403:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316891.544411:0:82992:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316891.544415:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b5f 00000080:00010000:1.0:1767316891.544422:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b5f from it ffffa99f414ebcd8 00010000:00010000:1.0:1767316891.544426:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.544887:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.544912:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1767316891.544923:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316891.544935:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316891.544938:0:82992:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767316891.544960:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316891.544963:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x400000400001002 00010000:00010000:1.0:1767316891.544978:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.544986:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.544995:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316891.544997:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.545002:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316891.545010:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316891.545021:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:1.0:1767316891.545024:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:1.0:1767316891.545027:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.545030:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316891.545041:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316891.545043:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316891.545053:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316891.545110:0:82992:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8) current size 29, valid attrs 2068, mode 0, uid -1941070030, gid -1, new size 29, atime 1767316891.000000000, mtime 1767316891.000000000, ctime 1767316891.000000000 00010000:00010000:1.0:1767316891.545133:0:82992:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.545149:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.545186:0:82992:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.545191:0:82992:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316891.545193:0:82992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b5f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac5d5 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767316891.545207:0:82992:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316891.545216:0:82992:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c380 x1853163894025984/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316891.545233:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894025984:192.168.202.121@tcp:36:lfs.0 00000100:00100000:1.0:1767316891.546821:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:1.0:1767316891.554560:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894025984:192.168.202.121@tcp:36:lfs.0 00000080:00200000:1.0:1767316891.554603:0:82992:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000080:00200000:1.0:1767316891.554609:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767316891.554628:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:1.0:1767316891.554641:0:82992:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1767316891.554673:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767316891.554687:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79bb0, osc lock ffff9cfe09c74130, flags 0x0 00010000:00010000:1.0:1767316891.554746:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.554757:0:82992:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.554767:0:82992:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316891.554787:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894026112:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316891.555374:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:2.0:1767316891.558518:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894026112:192.168.202.121@tcp:101:lfs.0 00010000:00010000:2.0:1767316891.558552:0:82992:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac5ff expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316891.558568:0:82992:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac5ff expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316891.558582:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac5ff expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767316891.558613:0:82992:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 4/0,2 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac5ff expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316891.558626:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5ff expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316891.558634:0:82992:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5ff expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1767316891.558804:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894026240:192.168.202.121@tcp:10:lfs.0 00000100:00100000:2.0:1767316891.563875:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894026240:192.168.202.121@tcp:10:lfs.0 00000080:00200000:0.0:1767316891.564053:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:0.0:1767316891.564060:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:0.0:1767316891.564063:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316891.564068:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79bb0 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00010000:00010000:0.0:1767316891.564391:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5ff expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.564405:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5ff expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00010000:0.0:1767316891.564430:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316891.564433:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79bb0 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316891.564452:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767316891.564475:0:82992:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8) current size 29, valid attrs 2168, mode 0, uid -1941070030, gid -1, new size 29, atime 1767316891.000000000, mtime 1767316891.000000000, ctime 1767316891.000000000, rc 0 00000080:00200080:0.0:1767316891.564494:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:0.0:1767316891.564501:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=3 00000080:00200008:0.0:1767316891.564508:0:82992:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316891.564515:0:82992:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:0.0:1767316891.564532:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316891.564545:0:82992:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:0.0:1767316891.564588:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82992 initiator: MDT0 00010000:00010000:0.0:1767316891.564597:0:82992:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00010000:00010000:0.0:1767316891.564607:0:82992:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00000100:00100000:0.0:1767316891.564630:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894026368:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316891.564854:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316891.572002:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894026368:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316891.572038:0:82992:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac60d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.572050:0:82992:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac60d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.572063:0:82992:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac60d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.572181:0:82992:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac60d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.572193:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac60d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.572201:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac60d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.572208:0:82992:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac60d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316891.572218:0:82992:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d8e00 x1853163894026368/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/928 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316891.572230:0:82992:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac60d expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316891.572243:0:82992:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac60d expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.572256:0:82992:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767316891.572263:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316891.572321:0:82992:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 5 -> 5 00000080:00010000:0.0:1767316891.572326:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b74 00000080:00010000:0.0:1767316891.572331:0:82992:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316891.572334:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b74 from it ffffa99f414ebcd8 00010000:00010000:0.0:1767316891.572337:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac60d expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.572351:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac60d expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316891.572384:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:0.0:1767316891.572394:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316891.572397:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316891.572401:0:82992:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:0.0:1767316891.572418:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316891.572421:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9930, osc lock ffff9cfe201dabe0, flags 0x400000400001002 00010000:00010000:0.0:1767316891.572436:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.572448:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316891.572459:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316891.572463:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.572470:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316891.572479:0:82992:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316891.572488:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:0.0:1767316891.572492:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:0.0:1767316891.572495:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316891.572498:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9930 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316891.572509:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316891.572512:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9930 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316891.572521:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767316891.572558:0:82992:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8) current size 29, valid attrs 2068, mode 0, uid -1941070030, gid -1, new size 29, atime 1767316891.000000000, mtime 1767316891.000000000, ctime 1767316891.000000000 00010000:00010000:0.0:1767316891.572585:0:82992:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac60d expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.572601:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.572636:0:82992:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac60d expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.572642:0:82992:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316891.572645:0:82992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b74 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac60d expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767316891.572662:0:82992:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316891.572668:0:82992:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8e00 x1853163894026624/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316891.572689:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894026624:192.168.202.121@tcp:36:lfs.0 00000100:00100000:0.0:1767316891.572762:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316891.578661:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894026624:192.168.202.121@tcp:36:lfs.0 00000080:00200000:0.0:1767316891.578715:0:82992:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 3 00000080:00200000:0.0:1767316891.578722:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:0.0:1767316891.578742:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:0.0:1767316891.578758:0:82992:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1767316891.578785:0:82992:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1767316891.578789:0:82992:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9930, osc lock ffff9cfe201dabe0, flags 0x0 00010000:00010000:0.0:1767316891.578855:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.578867:0:82992:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.578877:0:82992:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316891.578908:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894026752:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316891.578982:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316891.581860:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894026752:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316891.581891:0:82992:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac61b expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.581916:0:82992:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac61b expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.581939:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac61b expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316891.581952:0:82992:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac61b expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.581964:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac61b expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.581984:0:82992:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac61b expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316891.582124:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316891.582141:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894026880:192.168.202.121@tcp:10:lfs.0 00000100:00100000:0.0:1767316891.587803:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894026880:192.168.202.121@tcp:10:lfs.0 00000080:00200000:2.0:1767316891.587912:0:82992:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:2.0:1767316891.587921:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:2.0:1767316891.587933:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316891.587938:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9930 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767316891.587950:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac61b expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316891.587964:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac61b expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767316891.587980:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102845d8 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316891.587983:0:82992:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9930 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316891.588002:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767316891.588012:0:82992:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8) current size 29, valid attrs 2168, mode 0, uid -1941070030, gid -1, new size 29, atime 1767316891.000000000, mtime 1767316891.000000000, ctime 1767316891.000000000, rc 0 00000080:00200080:2.0:1767316891.588288:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200008:2.0:1767316891.588318:0:82992:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8) current size 29, valid attrs 101f0, mode a99f, uid 35988752, gid -25346, new size 18446635213879345352, atime 1767316891.000000000, mtime 1767316891.000000000, ctime 1767316891.000000000 00000020:00100000:2.0:1767316891.588378:0:82992:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767316891.588385:0:82992:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29109c00 x1853163894027136/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767316891.588405:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894027136:192.168.202.121@tcp:36:lfs.0 00000100:00100000:2.0:1767316891.588468:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe190a86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316891.590942:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894027136:192.168.202.121@tcp:36:lfs.0 00000080:00200000:2.0:1767316891.590996:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1767316891.591009:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316891.591011:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767316891.591018:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:3.0:1767316891.591305:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894027264:192.168.202.121@tcp:2:lfs.0 00000100:00100000:2.0:1767316891.593222:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894027264:192.168.202.121@tcp:2:lfs.0 00000080:00200000:0.0:1767316891.593439:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767316891.593459:0:82992:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8) current size 29, valid attrs 101f0, mode a99f, uid 35988752, gid -25346, new size 18446635213879345352, atime 1767316891.000000000, mtime 1767316891.000000000, ctime 1767316891.000000000, rc 0 00000080:00200080:0.0:1767316891.593484:0:82992:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=c00c66f3 arg=189a2a0 00010000:00010000:0.0:1767316891.593543:0:82992:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56b51 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x863eb2f6655ac5ab expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.593563:0:82992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56b51 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x863eb2f6655ac5ab expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316891.593582:0:82992:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3d880 x1853163894024064/t8589937406(8589937406) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316891.593594:0:82992:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316891.593600:0:82992:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9f80 x1853163894027520/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316891.593622:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894027520:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316891.593783:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1767316891.596195:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316891.596343:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939793280 00000100:00100000:2.0:1767316891.596353:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939793280 00000100:00100000:2.0:1767316891.596416:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10203 00000100:00100000:2.0:1767316891.596426:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15471:x1853163939793280:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316891.596442:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316891.596516:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316891.596523:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15471:x1853163939793280:12345-192.168.202.121@tcp:104: Request processed in 99us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316891.596546:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10203 00010000:00010000:0.0:1767316891.596827:0:49629:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316891.596834:0:49629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.596842:0:49629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2da00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316891.596847:0:49629:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.596855:0:49629:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.596863:0:49629:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316891.596888:0:49629:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:0.0:1767316891.596939:0:49629:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.596947:0:49629:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316891.596979:0:49629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.596986:0:49629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56b58 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac5c7 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.597002:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316891.597004:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316891.597016:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316891.597165:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894027648:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316891.601371:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894027648:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316891.605709:0:82992:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937413 gen 1 00000100:00100000:0.0:1767316891.605752:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894027520:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316891.605873:0:82992:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3d880 x1853163894024064/t8589937406(8589937406) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767316891.605911:0:82992:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 31 res 8589935621/144 (0 0) 00000080:00010000:0.0:1767316891.605922:0:82992:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000002:00010000:0.0:1767316891.605940:0:82992:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:0.0:1767316891.605981:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82992 initiator: MDT0 00010000:00010000:0.0:1767316891.605990:0:82992:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00010000:00010000:0.0:1767316891.605999:0:82992:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82992 initiator: MDT0 00000100:00100000:0.0:1767316891.606019:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894027776:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316891.606115:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316891.609307:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894027776:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316891.609340:0:82992:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.609356:0:82992:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316891.609370:0:82992:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe191d9f80 x1853163894027776/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/688 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316891.609382:0:82992:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767316891.609415:0:82992:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.609427:0:82992:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767316891.609434:0:82992:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316891.609451:0:82992:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b82 00000080:00010000:0.0:1767316891.609460:0:82992:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b82 from it ffffa99f414ebbc8 00010000:00010000:0.0:1767316891.609464:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.609473:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.609497:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.609507:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316891.609515:0:82992:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.609558:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.609566:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316891.609593:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:0.0:1767316891.609604:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316891.609607:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316891.609614:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316891.609640:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1767316891.609653:0:82992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.609660:0:82992:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316891.609667:0:82992:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316891.609748:0:82992:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316891.609758:0:82992:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316891.609760:0:82992:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316891.609763:0:82992:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316891.609796:0:82992:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1767316891.609809:0:82992:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 29 blocks 8 [cma]time: 1767316891 1767316891 0 by oinfo size 29 blocks 8 [cma]time 1767316891 1767316891 1767316891 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316891.609833:0:82992:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1767316891 1767316891 0 by oinfo size 29 blocks 8 [cma]time 1767316891 1767316891 0 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 1/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5ff expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316891.609848:0:82992:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1767316891 1767316891 0 by oinfo size 29 blocks 8 [cma]time 1767316891 1767316891 0 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 1/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac61b expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316891.609903:0:82992:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 6 00010000:00010000:0.0:1767316891.609909:0:82992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.609916:0:82992:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316891.609959:0:82992:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 154002 00000002:00100000:0.0:1767316891.610004:0:82992:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3c000 x1853163894023424/t8589937405(8589937405) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316891.610016:0:82992:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316891.610021:0:82992:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9f80 x1853163894028032/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316891.610043:0:82992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894028032:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316891.610314:0:82992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316891.614890:0:82992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82992:1853163894028032:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316891.614945:0:82992:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3c000 x1853163894023424/t8589937405(8589937405) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767316891.646987:0:82994:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316891.647025:0:82994:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316891.647039:0:82994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316891.647052:0:82994:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316891.647057:0:82994:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316891.647066:0:82994:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316891.647068:0:82994:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:2.0:1767316891.647074:0:82994:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f40ddbbf8 00010000:00010000:2.0:1767316891.647094:0:82994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316891.647106:0:82994:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316891.647124:0:82994:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316891.647140:0:82994:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), file ffff9cfe102bbc80, open_flags 18800, mode 0 opened 0 00000080:00200000:2.0:1767316891.647148:0:82994:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open 00000002:00010000:2.0:1767316891.647163:0:82994:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0304001 00010000:00010000:2.0:1767316891.647217:0:82994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56b89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82994 initiator: MDT0 00010000:00010000:2.0:1767316891.647224:0:82994:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56b89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82994 initiator: MDT0 00000020:00100000:2.0:1767316891.647245:0:82994:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767316891.647257:0:82994:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe2910bb80 x1853163894028288/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767316891.647267:0:82994:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56b89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82994 initiator: MDT0 00000100:00100000:2.0:1767316891.647301:0:82994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82994:1853163894028288:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316891.647475:0:82994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe190a8840 going to sleep for 11 seconds 00000100:00100000:2.0:1767316891.659198:0:82994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82994:1853163894028288:192.168.202.121@tcp:101:lfs.0 00010000:00010000:2.0:1767316891.659227:0:82994:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56b89 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82994 initiator: MDT0 00010000:00010000:2.0:1767316891.659242:0:82994:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56b89 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82994 initiator: MDT0 00010000:00010000:2.0:1767316891.659249:0:82994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56b89 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82994 initiator: MDT0 00010000:00010000:2.0:1767316891.659256:0:82994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56b89 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 82994 initiator: MDT0 00010000:00010000:2.0:1767316891.659263:0:82994:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56b89 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 82994 initiator: MDT0 00010000:00010000:2.0:1767316891.659270:0:82994:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05094a00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:2.0:1767316891.659275:0:82994:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56b89 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82994 initiator: MDT0 00010000:00010000:2.0:1767316891.659282:0:82994:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56b89 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 82994 initiator: MDT0 00010000:00010000:2.0:1767316891.659319:0:82994:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56b89 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 82994 initiator: MDT0 00010000:00010000:2.0:1767316891.659325:0:82994:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767316891.659332:0:82994:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56b89 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82994 initiator: MDT0 00010000:00010000:2.0:1767316891.659338:0:82994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56b89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 82994 initiator: MDT0 00000002:00100000:2.0:1767316891.659359:0:82994:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=-20 req@ffff9cfe2910bb80 x1853163894028288/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/608 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767316891.659375:0:82994:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc -20 00000080:00200000:3.0:1767316891.659988:0:82994:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:3.0:1767316891.660025:0:82994:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316891.660040:0:82994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.660051:0:82994:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316891.660059:0:82994:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316891.660065:0:82994:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:3.0:1767316891.660068:0:82994:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:3.0:1767316891.660074:0:82994:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f40ddbbb0 00010000:00010000:3.0:1767316891.660077:0:82994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.660406:0:82994:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316891.660420:0:82994:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 44 00000080:00200008:3.0:1767316891.660430:0:82994:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags 304000 00000080:00200080:3.0:1767316891.660465:0:82994:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148) cmd=c0086915 arg=26693d0 00000100:00100000:3.0:1767316891.660530:0:82994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82994:1853163894028416:192.168.202.121@tcp:34:lfs.0 00000100:00100000:2.0:1767316891.661149:0:82994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0f1ae9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316891.665004:0:82994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82994:1853163894028416:192.168.202.121@tcp:34:lfs.0 00000080:00200008:3.0:1767316891.665490:0:82994:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags 304000 00000080:00200000:3.0:1767316891.707577:0:82996:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:3.0:1767316891.707612:0:82996:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316891.707630:0:82996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.707889:0:82996:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316891.707899:0:82996:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316891.707907:0:82996:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:3.0:1767316891.707911:0:82996:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:3.0:1767316891.707918:0:82996:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f415fbb58 00010000:00010000:3.0:1767316891.707933:0:82996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316891.708597:0:82996:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316891.708617:0:82996:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:3.0:1767316891.708901:0:82996:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=9 00000080:00200000:3.0:1767316891.708907:0:82996:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:3.0:1767316891.708936:0:82996:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316891.708989:0:82996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82996 initiator: MDT0 00010000:00010000:3.0:1767316891.708997:0:82996:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82996 initiator: MDT0 00010000:00010000:3.0:1767316891.709005:0:82996:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82996 initiator: MDT0 00000100:00100000:3.0:1767316891.709030:0:82996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82996:1853163894028544:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316891.709347:0:82996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0f1aed80 going to sleep for 11 seconds 00010000:00010000:3.0:1767316891.718537:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316891.719312:0:82996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82996:1853163894028544:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316891.719336:0:82996:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.719353:0:82996:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.719370:0:82996:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.719381:0:82996:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.719391:0:82996:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.719403:0:82996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.719410:0:82996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.719417:0:82996:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316891.719426:0:82996:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18fd7b80 x1853163894028544/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/928 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316891.719437:0:82996:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316891.719450:0:82996:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.719458:0:82996:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767316891.719465:0:82996:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316891.719516:0:82996:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:0.0:1767316891.719520:0:82996:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x90:0x0](ffff9cfe187d80c8): rc = 0 00000080:00200000:0.0:1767316891.719532:0:82996:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 6 -> 6 00000080:00010000:0.0:1767316891.719537:0:82996:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b90 00000080:00010000:0.0:1767316891.719548:0:82996:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316891.719552:0:82996:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b90 from it ffffa99f415fbb20 00010000:00010000:0.0:1767316891.719555:0:82996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.719563:0:82996:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316891.719602:0:82996:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316891.719610:0:82996:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:0.0:1767316891.719631:0:82996:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316891.719936:0:82996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.719948:0:82996:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316891.719955:0:82996:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316891.719961:0:82996:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316891.719964:0:82996:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b90 00000080:00010000:0.0:1767316891.719968:0:82996:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b90 from it ffffa99f415fbcb8 00010000:00010000:0.0:1767316891.719972:0:82996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.719979:0:82996:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.720476:0:82996:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316891.720490:0:82996:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.720498:0:82996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.720507:0:82996:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.720514:0:82996:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316891.720518:0:82996:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316891.720520:0:82996:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:1.0:1767316891.720524:0:82996:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f415fbbf8 00010000:00010000:1.0:1767316891.720527:0:82996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.720539:0:82996:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.720549:0:82996:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316891.720556:0:82996:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:1.0:1767316891.720560:0:82996:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 44 00000080:00200008:1.0:1767316891.720568:0:82996:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 154400 00000002:00010000:1.0:1767316891.720585:0:82996:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240114401 00010000:00010000:1.0:1767316891.720634:0:82996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82996 initiator: MDT0 00010000:00010000:1.0:1767316891.720943:0:82996:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82996 initiator: MDT0 00000020:00100000:1.0:1767316891.720958:0:82996:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316891.720968:0:82996:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c000 x1853163894028800/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316891.720975:0:82996:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82996 initiator: MDT0 00000100:00100000:1.0:1767316891.720994:0:82996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82996:1853163894028800:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316891.721310:0:82996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316891.726215:0:82996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82996:1853163894028800:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316891.726245:0:82996:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.726262:0:82996:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.726287:0:82996:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.726297:0:82996:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.726307:0:82996:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.726319:0:82996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.726326:0:82996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.726334:0:82996:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316891.726345:0:82996:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe18f3c000 x1853163894028800/t8589937415(8589937415) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316907 ref 3 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316891.726356:0:82996:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3c000 x1853163894028800/t8589937415(8589937415) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316907 ref 3 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316891.726371:0:82996:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316891.726383:0:82996:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.726404:0:82996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.726415:0:82996:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.726423:0:82996:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.726429:0:82996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.726435:0:82996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.726502:0:82996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:1.0:1767316891.726509:0:82996:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316891.726561:0:82996:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:1.0:1767316891.726576:0:82996:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 6 -> 6 00000080:00010000:1.0:1767316891.726581:0:82996:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b90 00000080:00010000:1.0:1767316891.726588:0:82996:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b90 from it ffffa99f415fbbf0 00010000:00010000:1.0:1767316891.726591:0:82996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.726600:0:82996:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767316891.726624:0:82996:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3c000 x1853163894028800/t8589937415(8589937415) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 3 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:1.0:1767316891.726718:0:82996:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=c00c66f3 arg=7fffd0f231c4 00000002:00010000:1.0:1767316891.726742:0:82996:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 01004040000001 00010000:00010000:1.0:1767316891.726784:0:82996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 82996 initiator: MDT0 00010000:00010000:1.0:1767316891.726790:0:82996:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82996 initiator: MDT0 00000020:00100000:1.0:1767316891.727161:0:82996:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316891.727171:0:82996:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3d880 x1853163894029056/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316891.727193:0:82996:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x81000000000000 pid: 82996 initiator: MDT0 00000100:00100000:1.0:1767316891.727219:0:82996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82996:1853163894029056:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316891.727366:0:82996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00010000:00010000:0.0:1767316891.732014:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316891.732030:0:59093:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.732043:0:59093:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2cc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316891.732048:0:59093:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.732057:0:59093:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.732066:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.732200:0:59093:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.732245:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.732252:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316891.732286:0:59093:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.732293:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56b97 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac684 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1767316891.732332:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316891.732352:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894029184:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767316891.732443:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316891.732445:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316891.732447:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316891.733177:0:82996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82996:1853163894029056:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316891.733196:0:82996:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac699 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.733206:0:82996:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 4/1,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac699 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.733217:0:82996:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac699 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.733226:0:82996:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac699 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.733238:0:82996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac699 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.733246:0:82996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac699 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.733253:0:82996:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac699 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316891.733277:0:82996:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff9cfe18f3d880 x1853163894029056/t8589937416(8589937416) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316891.733290:0:82996:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3d880 x1853163894029056/t8589937416(8589937416) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316891.733305:0:82996:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac699 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.733315:0:82996:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 2 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316891.733321:0:82996:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1767316891.733336:0:82996:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3d880 x1853163894029056/t8589937416(8589937416) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767316891.733344:0:82996:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b9e 00000080:00010000:1.0:1767316891.733350:0:82996:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b9e from it ffffa99f415fbcc0 00010000:00010000:1.0:1767316891.733353:0:82996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac699 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.733360:0:82996:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac699 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.733558:0:82996:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1767316891.733568:0:82996:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), xattr lov 00000080:00200008:1.0:1767316891.733600:0:82996:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316891.733607:0:82996:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316891.733627:0:82996:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.733635:0:82996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.733649:0:82996:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316891.733655:0:82996:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316891.733660:0:82996:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316891.733664:0:82996:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b90 00000080:00010000:1.0:1767316891.733669:0:82996:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b90 from it ffffa99f415fbcd8 00010000:00010000:1.0:1767316891.733672:0:82996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.733694:0:82996:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00000080:00200080:1.0:1767316891.733914:0:82996:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=66f4 arg=1 00000100:00100000:0.0:1767316891.743378:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894029184:192.168.202.121@tcp:103:ldlm_bl.0 00000080:00200080:2.0:1767316891.787309:0:82996:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=1 00000080:00200008:2.0:1767316891.787330:0:82996:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316891.787339:0:82996:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:2.0:1767316891.787367:0:82996:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316891.787384:0:82996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316891.787399:0:82996:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316891.787408:0:82996:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316891.787417:0:82996:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:2.0:1767316891.787426:0:82996:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b90 00000080:00010000:2.0:1767316891.787434:0:82996:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b90 from it ffffa99f415fbcd8 00010000:00010000:2.0:1767316891.787438:0:82996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316891.787446:0:82996:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767316891.787479:0:82996:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:2.0:1767316891.787490:0:82996:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767316891.787502:0:82996:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316891.787506:0:82996:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767316891.787519:0:82996:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316891.787528:0:82996:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767316891.787538:0:82996:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000020:00200000:2.0:1767316891.787545:0:82996:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767316891.787547:0:82996:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767316891.787549:0:82996:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 restore needed 0 00000080:00200000:2.0:1767316891.787556:0:82996:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767316891.787564:0:82996:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767316891.787568:0:82996:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316891.787586:0:82996:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767316891.787601:0:82996:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767316891.787605:0:82996:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f6b0, osc lock ffff9cfe2013cab0, flags 0x40000 00000080:00200000:2.0:1767316891.787613:0:82996:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000001:00010000:2.0:1767316891.787619:0:82996:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:2.0:1767316891.787622:0:82996:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316891.787624:0:82996:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f330, osc lock ffff9cfe2013d560, flags 0x400001002 00010000:00010000:2.0:1767316891.787635:0:82996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316891.787655:0:82996:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767316891.787669:0:82996:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316891.787679:0:82996:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316891.787682:0:82996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316891.787690:0:82996:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316891.787702:0:82996:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316891.787709:0:82996:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:2.0:1767316891.787712:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b0248 (ffff9cfe0e436ea8/0) at cl_lock_release():245 00000020:00010000:2.0:1767316891.787716:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b0248 (ffff9cfe0e436ea8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316891.787719:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f330 (ffff9cfe0e436e18/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316891.787722:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b0248 (ffff9cfe0e436ea8/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316891.787724:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f330 (ffff9cfe0e436ea8/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316891.787732:0:82996:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:2.0:1767316891.787739:0:82996:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:2.0:1767316891.787790:0:82996:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316891.787793:0:82996:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:2.0:1767316891.787799:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe275764e8 (ffff9cfe0e436ea8/0) at cl_lock_release():245 00000020:00010000:2.0:1767316891.787801:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe275764e8 (ffff9cfe0e436ea8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316891.787810:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f6b0 (ffff9cfe0e436e18/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316891.787813:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe275764e8 (ffff9cfe0e436ea8/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316891.787815:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f6b0 (ffff9cfe0e436ea8/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316891.787821:0:82996:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:2.0:1767316891.787826:0:82996:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316891.787850:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000008:00100000:2.0:1767316891.787892:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe2910bb80 - object 0x280000400:162 offset 0<>29 00000100:00100000:2.0:1767316891.787956:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767316891.787976:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894029312:192.168.202.121@tcp:3:lfs.0 00000008:00010000:2.0:1767316891.797182:0:2504:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000020:00200000:2.0:1767316891.797196:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767316891.797205:0:2504:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:2.0:1767316891.797214:0:2504:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:2.0:1767316891.797226:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767316891.797279:0:2504:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000100:00100000:2.0:1767316891.797304:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894029312:192.168.202.121@tcp:3:lfs.0 00000080:00200000:0.0:1767316891.797373:0:82996:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767316891.797387:0:82996:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316891.797392:0:82996:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:0.0:1767316891.797395:0:82996:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316891.797404:0:82996:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:0.0:1767316891.797422:0:82996:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:0.0:1767316891.797467:0:82996:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=2 00000080:00200008:0.0:1767316891.797475:0:82996:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316891.797484:0:82996:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:0.0:1767316891.797514:0:82996:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316891.797533:0:82996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.797569:0:82996:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316891.797579:0:82996:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316891.797587:0:82996:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316891.797590:0:82996:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b90 00000080:00010000:0.0:1767316891.797598:0:82996:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b90 from it ffffa99f415fbcd8 00010000:00010000:0.0:1767316891.797602:0:82996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.797610:0:82996:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316891.797908:0:82996:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:0.0:1767316891.797917:0:82996:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 restore needed 0 00020000:00200000:0.0:1767316891.797938:0:82996:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316891.797941:0:82996:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:0.0:1767316891.797951:0:82996:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316891.797958:0:82996:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:0.0:1767316891.797968:0:82996:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:0.0:1767316891.797974:0:82996:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:0.0:1767316891.797976:0:82996:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:0.0:1767316891.797979:0:82996:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 restore needed 0 00000080:00200000:0.0:1767316891.797986:0:82996:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1767316891.797993:0:82996:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:0.0:1767316891.797997:0:82996:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:0.0:1767316891.798197:0:82996:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:0.0:1767316891.798211:0:82996:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:0.0:1767316891.798222:0:82996:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc99b0, osc lock ffff9cfe201daf70, flags 0x40000 00000080:00200000:0.0:1767316891.798231:0:82996:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:0.0:1767316891.798240:0:82996:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:0.0:1767316891.798246:0:82996:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:0.0:1767316891.798293:0:82996:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1767316891.798296:0:82996:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:0.0:1767316891.798302:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe275764e8 (ffff9cfe0e436ea8/0) at cl_lock_release():245 00000020:00010000:0.0:1767316891.798306:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe275764e8 (ffff9cfe0e436ea8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316891.798308:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc99b0 (ffff9cfe0e436e18/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316891.798311:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe275764e8 (ffff9cfe0e436ea8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316891.798314:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc99b0 (ffff9cfe0e436ea8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316891.798321:0:82996:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:0.0:1767316891.798326:0:82996:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1767316891.798344:0:49615:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe21417840 00000008:00100000:0.0:1767316891.798392:0:49615:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe191d9f80 - object 0x2c0000400:161 offset 0<>29 00000100:00100000:1.0:1767316891.798477:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894029440:192.168.202.121@tcp:3:lfs.0 00000100:00100000:3.0:1767316891.801264:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316891.801596:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939794048 00000100:00100000:2.0:1767316891.801606:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939794048 00000100:00100000:2.0:1767316891.802137:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10204 00000100:00100000:2.0:1767316891.802149:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:36248:x1853163939794048:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316891.802166:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac5ff expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316891.802253:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316891.802261:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:36248:x1853163939794048:12345-192.168.202.121@tcp:104: Request processed in 116us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316891.802268:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10204 00010000:00010000:1.0:1767316891.802316:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316891.802323:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac5ff expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.802331:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d800 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:1.0:1767316891.802337:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac5ff expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.802377:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac5ff expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.802402:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316891.802432:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac5ff expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.802440:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56b6d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac5ff expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316891.802464:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316891.802465:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316891.802468:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316891.802477:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316891.802492:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894029568:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316891.809943:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894029568:192.168.202.121@tcp:103:ldlm_bl.0 00000008:00010000:1.0:1767316891.810028:0:2503:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe21417840 00000020:00200000:1.0:1767316891.810035:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:1.0:1767316891.810042:0:2503:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:1.0:1767316891.810050:0:2503:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:1.0:1767316891.810063:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:1.0:1767316891.810190:0:2503:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe21417840 00000100:00100000:1.0:1767316891.810217:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894029440:192.168.202.121@tcp:3:lfs.0 00000080:00200000:0.0:1767316891.812542:0:82996:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767316891.812571:0:82996:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316891.812578:0:82996:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:0.0:1767316891.812582:0:82996:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316891.812597:0:82996:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:0.0:1767316891.812617:0:82996:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:0.0:1767316891.812631:0:82996:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=3 00000080:00200008:0.0:1767316891.812638:0:82996:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316891.812646:0:82996:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:0.0:1767316891.812678:0:82996:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316891.812695:0:82996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.812710:0:82996:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316891.812732:0:82996:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316891.812742:0:82996:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316891.812745:0:82996:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56b90 00000080:00010000:0.0:1767316891.812753:0:82996:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b90 from it ffffa99f415fbcd8 00010000:00010000:0.0:1767316891.812979:0:82996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.812989:0:82996:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316891.813019:0:82996:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:0.0:1767316891.813029:0:82996:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 restore needed 0 00020000:00200000:0.0:1767316891.813040:0:82996:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316891.813043:0:82996:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:0.0:1767316891.813052:0:82996:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316891.813058:0:82996:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:0.0:1767316891.813068:0:82996:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 3 00000020:00200000:0.0:1767316891.813076:0:82996:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:0.0:1767316891.813100:0:82996:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:0.0:1767316891.813103:0:82996:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 restore needed 0 00000080:00200000:0.0:1767316891.813112:0:82996:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1767316891.813120:0:82996:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:0.0:1767316891.813123:0:82996:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1767316891.813140:0:82996:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:0.0:1767316891.813154:0:82996:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:0.0:1767316891.813328:0:82996:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc99b0, osc lock ffff9cfe201daf70, flags 0x40000 00000080:00200000:0.0:1767316891.813337:0:82996:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:0.0:1767316891.813345:0:82996:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:0.0:1767316891.813351:0:82996:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:0.0:1767316891.813409:0:82996:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1767316891.813412:0:82996:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:0.0:1767316891.813419:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe275764e8 (ffff9cfe0e436ea8/0) at cl_lock_release():245 00000020:00010000:0.0:1767316891.813423:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe275764e8 (ffff9cfe0e436ea8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316891.813425:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc99b0 (ffff9cfe0e436e18/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316891.813428:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe275764e8 (ffff9cfe0e436ea8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316891.813431:0:82996:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc99b0 (ffff9cfe0e436ea8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316891.813438:0:82996:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:0.0:1767316891.813443:0:82996:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1767316891.813467:0:49615:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe21417180 00000008:00100000:0.0:1767316891.813515:0:49615:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe191d8e00 - object 0x280000400:163 offset 0<>29 00000100:00100000:0.0:1767316891.813560:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316891.813579:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894029696:192.168.202.121@tcp:3:lfs.0 00000100:00100000:2.0:1767316891.816390:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316891.816522:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939794176 00000100:00100000:3.0:1767316891.816533:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939794176 00000100:00100000:3.0:1767316891.816630:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10205 00000100:00100000:3.0:1767316891.816639:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:36248:x1853163939794176:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316891.816656:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac61b expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316891.816753:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316891.816760:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:36248:x1853163939794176:12345-192.168.202.121@tcp:104: Request processed in 123us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316891.816767:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10205 00010000:00010000:0.0:1767316891.816835:0:63840:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316891.816843:0:63840:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac61b expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.816853:0:63840:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c000 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316891.816858:0:63840:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac61b expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.816899:0:63840:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac61b expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.816906:0:63840:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316891.816942:0:63840:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac61b expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.816961:0:63840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56b7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac61b expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316891.816985:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316891.816987:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316891.816989:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316891.820058:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894029824:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316891.826138:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894029824:192.168.202.121@tcp:103:ldlm_bl.0 00000008:00010000:1.0:1767316891.826277:0:2502:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe21417180 00000020:00200000:1.0:1767316891.826283:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:1.0:1767316891.826307:0:2502:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:1.0:1767316891.826316:0:2502:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:1.0:1767316891.826327:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:1.0:1767316891.826388:0:2502:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe21417180 00000100:00100000:1.0:1767316891.826411:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894029696:192.168.202.121@tcp:3:lfs.0 00000080:00200000:0.0:1767316891.826484:0:82996:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767316891.826498:0:82996:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 6 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316891.826503:0:82996:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:0.0:1767316891.826506:0:82996:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316891.826514:0:82996:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:0.0:1767316891.826533:0:82996:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:0.0:1767316891.836310:0:82996:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=c00c66f3 arg=7fffd0f231d4 00010000:00010000:0.0:1767316891.836339:0:82996:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x863eb2f6655ac699 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.836398:0:82996:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 1/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x863eb2f6655ac699 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.836406:0:82996:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767316891.836430:0:82996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82996:1853163894029952:192.168.202.121@tcp:103:lfs.0 00000100:00100000:0.0:1767316891.836594:0:82996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316891.840233:0:82996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82996:1853163894029952:192.168.202.121@tcp:103:lfs.0 00010000:00010000:0.0:1767316891.840274:0:82996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56b9e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x863eb2f6655ac699 expref: -99 pid: 82996 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316891.840345:0:82996:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3d880 x1853163894029056/t8589937416(8589937416) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316891.840370:0:82996:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316891.840377:0:82996:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9c00 x1853163894030208/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316891.840399:0:82996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82996:1853163894030208:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316891.840481:0:82996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316891.845414:0:82996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82996:1853163894030208:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316891.845450:0:82996:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3d880 x1853163894029056/t8589937416(8589937416) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316891.845500:0:82996:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 154000 00000002:00100000:0.0:1767316891.845553:0:82996:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3c000 x1853163894028800/t8589937415(8589937415) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316891.845563:0:82996:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316891.845568:0:82996:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9c00 x1853163894030464/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316891.845602:0:82996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82996:1853163894030464:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316891.845684:0:82996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316891.850453:0:82996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82996:1853163894030464:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316891.850485:0:82996:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3c000 x1853163894028800/t8589937415(8589937415) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316891.868264:0:82998:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316891.868295:0:82998:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.868313:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.868329:0:82998:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.868338:0:82998:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316891.868346:0:82998:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316891.868350:0:82998:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:1.0:1767316891.868356:0:82998:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f41d9bbf8 00010000:00010000:1.0:1767316891.868360:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.868368:0:82998:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316891.868383:0:82998:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316891.868391:0:82998:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:1.0:1767316891.868396:0:82998:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 42 00000080:00200008:1.0:1767316891.868402:0:82998:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 140001 00000002:00010000:1.0:1767316891.868418:0:82998:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 04240100002 00010000:00010000:1.0:1767316891.868471:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82998 initiator: MDT0 00010000:00010000:1.0:1767316891.868484:0:82998:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82998 initiator: MDT0 00000020:00100000:1.0:1767316891.868496:0:82998:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316891.868509:0:82998:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3d180 x1853163894030720/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316891.868518:0:82998:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82998 initiator: MDT0 00000100:00100000:1.0:1767316891.868539:0:82998:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894030720:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316891.868709:0:82998:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1767316891.874356:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316891.874619:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939794304 00000100:00100000:2.0:1767316891.874632:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939794304 00000100:00100000:2.0:1767316891.874695:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10206 00000100:00100000:2.0:1767316891.874706:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939794304:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316891.874733:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316891.874819:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316891.874825:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939794304:12345-192.168.202.121@tcp:104: Request processed in 122us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316891.874833:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10206 00010000:00010000:0.0:1767316891.875129:0:42048:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316891.875137:0:42048:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.875163:0:42048:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe27713200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316891.875168:0:42048:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.875176:0:42048:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.875185:0:42048:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.875211:0:42048:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.875251:0:42048:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.875256:0:42048:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316891.875280:0:42048:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.875287:0:42048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713200/0xd9a0da65fad56b90 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac676 expref: -99 pid: 82996 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316891.875301:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316891.875303:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316891.875305:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316891.875371:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894030848:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316891.886282:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894030848:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316891.886409:0:82998:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894030720:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316891.886429:0:82998:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.886446:0:82998:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.886454:0:82998:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.886465:0:82998:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.886475:0:82998:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.886505:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.886512:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.886519:0:82998:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316891.886530:0:82998:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe18f3d180 x1853163894030720/t8589937419(8589937419) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316891.886542:0:82998:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3d180 x1853163894030720/t8589937419(8589937419) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316891.886556:0:82998:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.886565:0:82998:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 8 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316891.886571:0:82998:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316891.886620:0:82998:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00010000:1.0:1767316891.886626:0:82998:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56ba5 00000080:00010000:1.0:1767316891.886632:0:82998:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ba5 from it ffffa99f41d9bbf0 00010000:00010000:1.0:1767316891.886636:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.886643:0:82998:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316891.886884:0:82998:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3d180 x1853163894030720/t8589937419(8589937419) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316891.887652:0:82998:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1767316891.887662:0:82998:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), xattr lov 00000080:00200008:1.0:1767316891.887891:0:82998:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316891.887900:0:82998:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316891.887916:0:82998:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316891.887936:0:82998:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:1.0:1767316891.887980:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82998 initiator: MDT0 00010000:00010000:1.0:1767316891.887988:0:82998:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82998 initiator: MDT0 00010000:00010000:1.0:1767316891.887997:0:82998:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82998 initiator: MDT0 00000100:00100000:1.0:1767316891.888471:0:82998:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894030976:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316891.888609:0:82998:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1767316891.893179:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316891.893951:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939794432 00000100:00100000:2.0:1767316891.893964:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939794432 00000100:00100000:2.0:1767316891.894027:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10207 00000100:00100000:2.0:1767316891.894036:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939794432:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316891.894052:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316891.895941:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316891.895964:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939794432:12345-192.168.202.121@tcp:104: Request processed in 1923us (2790us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316891.895977:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10207 00010000:00010000:0.0:1767316891.898054:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316891.898252:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.898267:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316891.898272:0:63142:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.898282:0:63142:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.898291:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.898360:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.898367:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767316891.898947:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894031104:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767316891.901232:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 1/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.901251:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ba5 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac6c3 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316891.901270:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316891.901273:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316891.901276:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316891.906163:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894031104:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316891.913995:0:82998:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894030976:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316891.914021:0:82998:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac6d8 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.914051:0:82998:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac6d8 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.914063:0:82998:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac6d8 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.914180:0:82998:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac6d8 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.914192:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac6d8 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.914200:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac6d8 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316891.914208:0:82998:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac6d8 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316891.914219:0:82998:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c700 x1853163894030976/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/928 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316891.914231:0:82998:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac6d8 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316891.914245:0:82998:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac6d8 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.914257:0:82998:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316891.914263:0:82998:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316891.914314:0:82998:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:1.0:1767316891.914328:0:82998:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 6 -> 6 00000080:00010000:1.0:1767316891.914334:0:82998:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bac 00000080:00010000:1.0:1767316891.914339:0:82998:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316891.914342:0:82998:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bac from it ffffa99f41d9bcd8 00010000:00010000:1.0:1767316891.914345:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac6d8 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316891.914353:0:82998:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac6d8 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00200080:2.0:1767316891.977514:0:82998:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=c00c66f3 arg=7ffced150c70 00000002:00010000:2.0:1767316891.977566:0:82998:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 05004040000002 00010000:00010000:2.0:1767316891.977648:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56bb3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82998 initiator: MDT0 00010000:00010000:2.0:1767316891.977659:0:82998:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56bb3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82998 initiator: MDT0 00000020:00100000:2.0:1767316891.977681:0:82998:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767316891.977694:0:82998:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29109500 x1853163894031360/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767316891.977705:0:82998:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56bb3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x81000000000000 pid: 82998 initiator: MDT0 00000100:00100000:2.0:1767316891.978673:0:82998:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894031360:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316891.979136:0:82998:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe190a8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1767316891.989212:0:82998:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894031360:192.168.202.121@tcp:101:lfs.0 00010000:00010000:2.0:1767316891.989239:0:82998:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56bb3 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac6e6 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316891.989251:0:82998:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56bb3 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac6e6 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316891.989263:0:82998:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56bb3 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac6e6 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316891.989274:0:82998:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56bb3 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac6e6 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316891.989285:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56bb3 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac6e6 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316891.989292:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56bb3 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac6e6 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316891.989318:0:82998:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56bb3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac6e6 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316891.989330:0:82998:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff9cfe29109500 x1853163894031360/t8589937420(8589937420) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767316891.989343:0:82998:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29109500 x1853163894031360/t8589937420(8589937420) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316891.989359:0:82998:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56bb3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac6e6 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316891.989372:0:82998:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 2 res 8589935621/144 (0 0) 00000080:00200000:2.0:1767316891.989379:0:82998:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000002:00100000:2.0:1767316891.989399:0:82998:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29109500 x1853163894031360/t8589937420(8589937420) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1767316891.989408:0:82998:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bb3 00000080:00010000:2.0:1767316891.989415:0:82998:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bb3 from it ffffa99f41d9bcc0 00010000:00010000:2.0:1767316891.989419:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56bb3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac6e6 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316891.989428:0:82998:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56bb3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac6e6 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316891.989487:0:82998:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767316891.989499:0:82998:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316891.989502:0:82998:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767316891.989513:0:82998:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:3.0:1767316891.989718:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894031488:192.168.202.121@tcp:1:lfs.0 00000100:00100000:3.0:1767316891.999567:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316892.000220:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939794560 00000100:00100000:2.0:1767316892.000233:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939794560 00000100:00100000:2.0:1767316892.000292:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10208 00000100:00100000:2.0:1767316892.000303:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:40542:x1853163939794560:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316892.000320:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316892.000407:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316892.000415:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:40542:x1853163939794560:12345-192.168.202.121@tcp:104: Request processed in 114us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316892.000423:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10208 00010000:00010000:1.0:1767316892.000506:0:63296:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316892.000514:0:63296:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.000524:0:63296:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2ce00 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:1.0:1767316892.000530:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316892.000550:0:63296:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767316892.000566:0:63296:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1767316892.000606:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.000612:0:63296:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316892.003515:0:63296:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.003571:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56b66 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac5dc expref: -99 pid: 82992 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.003610:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316892.003613:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316892.003615:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316892.003636:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316892.003665:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894031616:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316892.008957:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894031616:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316892.012372:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894031488:192.168.202.121@tcp:1:lfs.0 00010000:00010000:1.0:1767316892.012498:0:82998:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.012525:0:82998:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:1.0:1767316892.012543:0:82998:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac6d8 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.012552:0:82998:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:1.0:1767316892.012587:0:82998:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.012595:0:82998:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac6d8 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.012600:0:82998:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316892.012602:0:82998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56b82 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac630 expref: -99 pid: 82992 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.012634:0:82998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bac lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac6d8 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767316892.012649:0:82998:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316892.012658:0:82998:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c700 x1853163894031872/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316892.012682:0:82998:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894031872:192.168.202.121@tcp:36:lfs.0 00000100:00100000:1.0:1767316892.012765:0:82998:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316892.033044:0:82998:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937421 gen 1 00000100:00100000:1.0:1767316892.033068:0:82998:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe18f3d180 x1853163894030720/t8589937419(8589937419) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767316892.033119:0:82998:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe29109500 x1853163894031360/t8589937420(8589937420) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767316892.033132:0:82998:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894031872:192.168.202.121@tcp:36:lfs.0 00010000:00010000:1.0:1767316892.033176:0:82998:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 31 res 8589935621/144 (0 0) 00000080:00010000:1.0:1767316892.033188:0:82998:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000002:00010000:1.0:1767316892.033198:0:82998:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:1.0:1767316892.033242:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 82998 initiator: MDT0 00010000:00010000:1.0:1767316892.033250:0:82998:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82998 initiator: MDT0 00010000:00010000:1.0:1767316892.033259:0:82998:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 82998 initiator: MDT0 00000100:00100000:1.0:1767316892.033295:0:82998:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894032000:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316892.033363:0:82998:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316892.039322:0:82998:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894032000:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316892.039352:0:82998:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.039367:0:82998:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767316892.039382:0:82998:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe18f3c700 x1853163894032000/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/688 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316892.039393:0:82998:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767316892.039405:0:82998:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.039418:0:82998:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316892.039424:0:82998:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316892.039441:0:82998:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bba 00000080:00010000:1.0:1767316892.039450:0:82998:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bba from it ffffa99f41d9bc70 00010000:00010000:1.0:1767316892.039453:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.039462:0:82998:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.039504:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.039515:0:82998:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767316892.039522:0:82998:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.039562:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.039570:0:82998:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.039584:0:82998:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316892.039593:0:82998:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316892.039596:0:82998:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316892.039602:0:82998:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316892.039625:0:82998:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1767316892.039634:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.039641:0:82998:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767316892.039648:0:82998:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.039674:0:82998:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316892.039678:0:82998:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316892.039680:0:82998:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316892.039682:0:82998:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316892.039690:0:82998:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316892.042143:0:82998:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 7 00010000:00010000:1.0:1767316892.042160:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.042173:0:82998:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00200080:1.0:1767316892.042200:0:82998:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=66f4 arg=7ffced150c70 00000080:00200080:1.0:1767316892.042230:0:82998:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=2 00000080:00200008:1.0:1767316892.042238:0:82998:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316892.042245:0:82998:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316892.042265:0:82998:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316892.042276:0:82998:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:1.0:1767316892.042317:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 82998 initiator: MDT0 00010000:00010000:1.0:1767316892.042326:0:82998:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82998 initiator: MDT0 00010000:00010000:1.0:1767316892.042334:0:82998:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 82998 initiator: MDT0 00000100:00100000:1.0:1767316892.042360:0:82998:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894032128:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316892.042463:0:82998:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316892.048833:0:82998:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894032128:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316892.048874:0:82998:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.048888:0:82998:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.048900:0:82998:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.048911:0:82998:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.048932:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.048939:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.048945:0:82998:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316892.048957:0:82998:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c700 x1853163894032128/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/928 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316892.048970:0:82998:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316892.048987:0:82998:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.049026:0:82998:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316892.049032:0:82998:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316892.049113:0:82998:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 7 -> 7 00000080:00010000:1.0:1767316892.049119:0:82998:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bc1 00000080:00010000:1.0:1767316892.049125:0:82998:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316892.049128:0:82998:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bc1 from it ffffa99f41d9bcd8 00010000:00010000:1.0:1767316892.049131:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.049139:0:82998:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.049180:0:82998:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 6 restore needed 0 00020000:00200000:1.0:1767316892.049193:0:82998:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316892.049196:0:82998:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316892.049200:0:82998:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767316892.049219:0:82998:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316892.049223:0:82998:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d798b0, osc lock ffff9cfe09c74980, flags 0x400000400001002 00010000:00010000:1.0:1767316892.049276:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.049285:0:82998:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.049296:0:82998:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe18f3c700 x1853163894032256/t0(0) o101->lustre-OST0001-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1767316892.049327:0:82998:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1767316892.049356:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894032256:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316892.053319:0:2502:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.053360:0:2502:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.053376:0:2502:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.053389:0:2502:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316892.053406:0:2502:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316892.053419:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767316892.053443:0:2502:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.053452:0:2502:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.053459:0:2502:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.053468:0:2502:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316892.053504:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894032256:192.168.202.121@tcp:101:lfs.0 00000080:00200000:2.0:1767316892.054622:0:82998:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:2.0:1767316892.054631:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b0ff8 (ffff9cfe0e436758/0) at cl_lock_release():245 00000020:00010000:2.0:1767316892.054636:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b0ff8 (ffff9cfe0e436758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.054641:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d798b0 (ffff9cfe0e4c8a28/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.054646:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b0ff8 (ffff9cfe0e436758/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316892.054650:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d798b0 (ffff9cfe0e436758/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316892.054669:0:82998:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 7 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767316892.054706:0:82998:0:(file.c:2648:do_file_write_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1767316892.054727:0:82998:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:2.0:1767316892.054741:0:82998:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:2.0:1767316892.054748:0:82998:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767316892.054750:0:82998:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 0 0 00000080:00200000:2.0:1767316892.054755:0:82998:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 7 restore needed 0 00000080:00200000:2.0:1767316892.054769:0:82998:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767316892.054777:0:82998:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1767316892.054794:0:82998:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:2.0:1767316892.054812:0:82998:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1767316892.054826:0:82998:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 10 00000008:00010000:2.0:1767316892.054831:0:82998:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f6b0, osc lock ffff9cfe2013cab0, flags 0x0 00000080:00200000:2.0:1767316892.054840:0:82998:0:(vvp_io.c:1312:vvp_io_write_start()) f212b.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000080:00200000:2.0:1767316892.054871:0:82998:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:2.0:1767316892.054949:0:82998:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316892.054952:0:82998:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000020:00010000:2.0:1767316892.054961:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe275765d8 (ffff9cfe0e436758/0) at cl_lock_release():245 00000020:00010000:2.0:1767316892.054964:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe275765d8 (ffff9cfe0e436758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.054967:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f6b0 (ffff9cfe0e4c8a28/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.054970:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe275765d8 (ffff9cfe0e436758/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316892.054972:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f6b0 (ffff9cfe0e436758/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316892.054979:0:82998:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1767316892.054986:0:82998:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316892.055011:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000008:00100000:2.0:1767316892.055155:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe29108a80 - object 0x2c0000400:161 offset 0<>4096 00000100:00100000:2.0:1767316892.055400:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767316892.055424:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894032384:192.168.202.121@tcp:4:lfs.0 00000100:00100000:2.0:1767316892.063753:0:2504:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff9cfe08c17800: committing for last_committed 25769805133 gen 1 00000008:00010000:2.0:1767316892.063806:0:2504:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000020:00200000:2.0:1767316892.063813:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767316892.063822:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767316892.063905:0:2504:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000100:00100000:2.0:1767316892.063942:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894032384:192.168.202.121@tcp:4:lfs.0 00000080:00200000:1.0:1767316892.064335:0:82998:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1767316892.064348:0:82998:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 7 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316892.064354:0:82998:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:1.0:1767316892.064367:0:82998:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 4096 i_blocks 16 00000020:00200000:1.0:1767316892.064370:0:82998:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316892.064381:0:82998:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:1.0:1767316892.064401:0:82998:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:1.0:1767316892.064408:0:82998:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=66f4 arg=0 00000080:00200080:1.0:1767316892.064424:0:82998:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=2 00000080:00200008:1.0:1767316892.064430:0:82998:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316892.064438:0:82998:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316892.064462:0:82998:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316892.064480:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.064495:0:82998:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.064502:0:82998:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316892.064509:0:82998:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316892.064512:0:82998:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bc1 00000080:00010000:1.0:1767316892.064517:0:82998:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bc1 from it ffffa99f41d9bcd8 00010000:00010000:1.0:1767316892.064520:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.064546:0:82998:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.064570:0:82998:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 7 restore needed 0 00020000:00200000:1.0:1767316892.064580:0:82998:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316892.064584:0:82998:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316892.064588:0:82998:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767316892.064605:0:82998:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316892.064610:0:82998:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d793b0, osc lock ffff9cfe09c75db0, flags 0x400000400001002 00010000:00010000:1.0:1767316892.064626:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.064635:0:82998:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316892.064646:0:82998:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316892.064649:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.064656:0:82998:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316892.064667:0:82998:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316892.064671:0:82998:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 4096 i_blocks 16 00000020:00010000:1.0:1767316892.064676:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b0ff8 (ffff9cfe0e436758/0) at cl_lock_release():245 00000020:00010000:1.0:1767316892.064679:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b0ff8 (ffff9cfe0e436758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316892.064682:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d793b0 (ffff9cfe0e4c8a28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316892.064692:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b0ff8 (ffff9cfe0e436758/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316892.064695:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d793b0 (ffff9cfe0e436758/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316892.064703:0:82998:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 7 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316892.064731:0:82998:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8) current size 4096, valid attrs 2068, mode 0, uid -1941070030, gid -1, new size 23, atime 1767316892.000000000, mtime 1767316892.000000000, ctime 1767316892.000000000 00010000:00010000:1.0:1767316892.064753:0:82998:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.064768:0:82998:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.064805:0:82998:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.064812:0:82998:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316892.064815:0:82998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bc1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac710 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767316892.064836:0:82998:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316892.064846:0:82998:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c700 x1853163894032640/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316892.064870:0:82998:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894032640:192.168.202.121@tcp:36:lfs.0 00000100:00100000:1.0:1767316892.065018:0:82998:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316892.070600:0:82998:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894032640:192.168.202.121@tcp:36:lfs.0 00000080:00200000:1.0:1767316892.070650:0:82998:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000080:00200000:1.0:1767316892.070659:0:82998:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 7 restore needed 0 00020000:00200000:1.0:1767316892.070696:0:82998:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:1.0:1767316892.070713:0:82998:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1767316892.070750:0:82998:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1767316892.070763:0:82998:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d793b0, osc lock ffff9cfe09c75db0, flags 0x0 00010000:00010000:1.0:1767316892.070820:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.070830:0:82998:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.070840:0:82998:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316892.070861:0:82998:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894032768:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316892.070941:0:82998:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316892.080263:0:82998:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894032768:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316892.080298:0:82998:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac72c expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.080315:0:82998:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac72c expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.080415:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac72c expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316892.080431:0:82998:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 4/0,2 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac72c expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.080446:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac72c expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.080470:0:82998:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac72c expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316892.080611:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894032896:192.168.202.121@tcp:10:lfs.0 00000100:00100000:0.0:1767316892.095748:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894032896:192.168.202.121@tcp:10:lfs.0 00000080:00200000:1.0:1767316892.098999:0:82998:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:1.0:1767316892.099213:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe275765d8 (ffff9cfe0e436758/0) at cl_lock_release():245 00000020:00010000:1.0:1767316892.099218:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe275765d8 (ffff9cfe0e436758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316892.099223:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d793b0 (ffff9cfe0e4c8a28/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767316892.099235:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac72c expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.099250:0:82998:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac72c expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767316892.099269:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe275765d8 (ffff9cfe0e436758/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316892.099273:0:82998:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d793b0 (ffff9cfe0e436758/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316892.099296:0:82998:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 7 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316892.099311:0:82998:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8) current size 29, valid attrs 2168, mode 0, uid -1941070030, gid -1, new size 23, atime 1767316892.000000000, mtime 1767316892.000000000, ctime 1767316892.000000000, rc 0 00000080:00200080:1.0:1767316892.099331:0:82998:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:1.0:1767316892.099339:0:82998:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=c00c66f3 arg=7ffced150c70 00010000:00010000:1.0:1767316892.099397:0:82998:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56bb3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x863eb2f6655ac6e6 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.099413:0:82998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56bb3 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x863eb2f6655ac6e6 expref: -99 pid: 82998 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316892.099455:0:82998:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe29109500 x1853163894031360/t8589937420(8589937420) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316892.099466:0:82998:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316892.099471:0:82998:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3e300 x1853163894033152/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316892.099494:0:82998:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894033152:192.168.202.121@tcp:35:lfs.0 00000100:00100000:1.0:1767316892.100382:0:82998:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316892.109308:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316892.110348:0:42040:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767316892.110371:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939795072 00000100:00100000:3.0:1767316892.110380:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939795072 00000100:00100000:3.0:1767316892.110502:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10209 00000100:00100000:3.0:1767316892.110513:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe28139850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15471:x1853163939795072:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316892.110529:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.110610:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316892.110616:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe28139850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15471:x1853163939795072:12345-192.168.202.121@tcp:104: Request processed in 106us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316892.110624:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10209 00010000:00010000:0.0:1767316892.110697:0:49629:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316892.110724:0:49629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.110733:0:49629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2cc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316892.110738:0:49629:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.110746:0:49629:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.110754:0:49629:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316892.110779:0:49629:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:0.0:1767316892.110826:0:49629:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 2/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.110833:0:49629:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316892.110868:0:49629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.110875:0:49629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bba lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac702 expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.110890:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316892.110892:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316892.110894:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316892.110904:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316892.110929:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894033280:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316892.117993:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894033280:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316892.126071:0:82998:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937424 gen 1 00000100:00100000:1.0:1767316892.126161:0:82998:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894033152:192.168.202.121@tcp:35:lfs.0 00000002:00100000:1.0:1767316892.126195:0:82998:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe29109500 x1853163894031360/t8589937420(8589937420) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767316892.126231:0:82998:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 31 res 8589935621/144 (0 0) 00000080:00010000:1.0:1767316892.126247:0:82998:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000002:00010000:1.0:1767316892.126257:0:82998:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:1.0:1767316892.126302:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82998 initiator: MDT0 00010000:00010000:1.0:1767316892.126312:0:82998:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82998 initiator: MDT0 00010000:00010000:1.0:1767316892.126322:0:82998:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82998 initiator: MDT0 00000100:00100000:1.0:1767316892.126342:0:82998:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894033408:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316892.126440:0:82998:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316892.132668:0:82998:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894033408:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316892.132702:0:82998:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.132717:0:82998:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767316892.132732:0:82998:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe18f3e300 x1853163894033408/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/688 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316892.132742:0:82998:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767316892.132754:0:82998:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.132768:0:82998:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316892.132775:0:82998:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316892.132791:0:82998:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bd6 00000080:00010000:1.0:1767316892.132801:0:82998:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bd6 from it ffffa99f41d9bbc8 00010000:00010000:1.0:1767316892.132805:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.132814:0:82998:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.132850:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.132862:0:82998:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767316892.132885:0:82998:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.132935:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.132943:0:82998:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.132962:0:82998:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316892.132973:0:82998:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316892.132976:0:82998:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316892.132982:0:82998:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316892.133008:0:82998:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1767316892.133021:0:82998:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.133029:0:82998:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767316892.133036:0:82998:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.133054:0:82998:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316892.133062:0:82998:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316892.133065:0:82998:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316892.133067:0:82998:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316892.133076:0:82998:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:1.0:1767316892.133128:0:82998:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 29 blocks 8 [cma]time: 1767316891 1767316891 1767316891 by oinfo size 29 blocks 8 [cma]time 1767316891 1767316891 1767316891 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316892.133158:0:82998:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1767316892 1767316892 0 by oinfo size 23 blocks 8 [cma]time 1767316892 1767316892 0 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 1/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac72c expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316892.133215:0:82998:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 8 00010000:00010000:1.0:1767316892.133220:0:82998:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.133227:0:82998:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767316892.153725:0:82998:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 140001 00000002:00100000:1.0:1767316892.153805:0:82998:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3d180 x1853163894030720/t8589937419(8589937419) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316892.153819:0:82998:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316892.153824:0:82998:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3e300 x1853163894033664/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316892.153848:0:82998:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894033664:192.168.202.121@tcp:35:lfs.0 00000100:00100000:1.0:1767316892.154032:0:82998:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316892.157899:0:82998:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82998:1853163894033664:192.168.202.121@tcp:35:lfs.0 00000002:00100000:1.0:1767316892.157949:0:82998:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3d180 x1853163894030720/t8589937419(8589937419) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316907 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767316892.169352:0:82999:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316892.169391:0:82999:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316892.169413:0:82999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316892.169435:0:82999:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316892.169443:0:82999:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316892.169452:0:82999:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316892.169456:0:82999:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:2.0:1767316892.169464:0:82999:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f420f7b58 00010000:00010000:2.0:1767316892.169468:0:82999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316892.169476:0:82999:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316892.169491:0:82999:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316892.169505:0:82999:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=9 00000080:00200000:2.0:1767316892.169509:0:82999:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:2.0:1767316892.169524:0:82999:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316892.169581:0:82999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82999 initiator: MDT0 00010000:00010000:2.0:1767316892.169588:0:82999:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82999 initiator: MDT0 00010000:00010000:2.0:1767316892.169599:0:82999:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82999 initiator: MDT0 00000100:00100000:2.0:1767316892.169629:0:82999:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82999:1853163894033792:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316892.169739:0:82999:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe190a8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1767316892.174994:0:82999:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82999:1853163894033792:192.168.202.121@tcp:101:lfs.0 00010000:00010000:3.0:1767316892.175020:0:82999:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.175037:0:82999:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.175045:0:82999:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.175055:0:82999:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.175064:0:82999:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.175118:0:82999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.175125:0:82999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.175132:0:82999:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316892.175142:0:82999:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe29108a80 x1853163894033792/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/928 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316892.175152:0:82999:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316892.175165:0:82999:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.175173:0:82999:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:3.0:1767316892.175180:0:82999:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767316892.175229:0:82999:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:3.0:1767316892.175234:0:82999:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x90:0x0](ffff9cfe187d80c8): rc = 0 00000080:00200000:3.0:1767316892.175251:0:82999:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 8 -> 8 00000080:00010000:3.0:1767316892.175257:0:82999:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bdd 00000080:00010000:3.0:1767316892.175267:0:82999:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:3.0:1767316892.175270:0:82999:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bdd from it ffffa99f420f7b20 00010000:00010000:3.0:1767316892.175274:0:82999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.175293:0:82999:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200008:3.0:1767316892.175332:0:82999:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316892.175340:0:82999:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:3.0:1767316892.175361:0:82999:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316892.175369:0:82999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.175379:0:82999:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316892.175386:0:82999:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316892.175391:0:82999:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:3.0:1767316892.175395:0:82999:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bdd 00000080:00010000:3.0:1767316892.175399:0:82999:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bdd from it ffffa99f420f7cb8 00010000:00010000:3.0:1767316892.175402:0:82999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.175409:0:82999:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316892.175459:0:82999:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:3.0:1767316892.175467:0:82999:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316892.175473:0:82999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.175490:0:82999:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316892.175497:0:82999:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316892.175500:0:82999:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:3.0:1767316892.175502:0:82999:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:3.0:1767316892.175506:0:82999:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f420f7bf8 00010000:00010000:3.0:1767316892.175509:0:82999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.175516:0:82999:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316892.175524:0:82999:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:3.0:1767316892.175531:0:82999:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:3.0:1767316892.175536:0:82999:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 44 00000080:00200008:3.0:1767316892.175544:0:82999:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 154400 00000002:00010000:3.0:1767316892.175559:0:82999:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114401 00010000:00010000:3.0:1767316892.175605:0:82999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 82999 initiator: MDT0 00010000:00010000:3.0:1767316892.175613:0:82999:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82999 initiator: MDT0 00000020:00100000:3.0:1767316892.175623:0:82999:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767316892.175629:0:82999:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18fd4a80 x1853163894034048/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767316892.175638:0:82999:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 82999 initiator: MDT0 00000100:00100000:3.0:1767316892.175666:0:82999:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82999:1853163894034048:192.168.202.121@tcp:101:lfs.0 00000100:00100000:3.0:1767316892.175829:0:82999:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0f1ae180 going to sleep for 11 seconds 00000100:00100000:3.0:1767316892.180415:0:82999:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82999:1853163894034048:192.168.202.121@tcp:101:lfs.0 00010000:00010000:3.0:1767316892.180449:0:82999:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.180459:0:82999:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.180471:0:82999:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.180480:0:82999:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316892.180494:0:82999:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe18fd4a80 x1853163894034048/t8589937426(8589937426) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767316892.180505:0:82999:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18fd4a80 x1853163894034048/t8589937426(8589937426) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316892.180518:0:82999:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316892.180530:0:82999:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.180539:0:82999:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:3.0:1767316892.180561:0:82999:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767316892.180613:0:82999:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:3.0:1767316892.180630:0:82999:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 8 -> 8 00000080:00010000:3.0:1767316892.180635:0:82999:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56be4 00000080:00010000:3.0:1767316892.180641:0:82999:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56be4 from it ffffa99f420f7bf0 00010000:00010000:3.0:1767316892.180644:0:82999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.180653:0:82999:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000002:00100000:3.0:1767316892.180678:0:82999:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18fd4a80 x1853163894034048/t8589937426(8589937426) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:3.0:1767316892.180782:0:82999:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=c00c66f3 arg=7fff45bf0e04 00000002:00010000:3.0:1767316892.180805:0:82999:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 01004040000001 00010000:00010000:3.0:1767316892.180852:0:82999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 82999 initiator: MDT0 00010000:00010000:3.0:1767316892.180860:0:82999:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 82999 initiator: MDT0 00000020:00100000:3.0:1767316892.180869:0:82999:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767316892.180875:0:82999:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18fd6d80 x1853163894034304/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767316892.180882:0:82999:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x81000000000000 pid: 82999 initiator: MDT0 00000100:00100000:3.0:1767316892.180899:0:82999:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82999:1853163894034304:192.168.202.121@tcp:101:lfs.0 00000100:00100000:3.0:1767316892.181104:0:82999:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0f1ae180 going to sleep for 11 seconds 00000100:00100000:3.0:1767316892.184818:0:82999:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82999:1853163894034304:192.168.202.121@tcp:101:lfs.0 00010000:00010000:3.0:1767316892.184847:0:82999:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac779 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.184859:0:82999:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 4/1,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac779 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.184872:0:82999:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac779 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.184882:0:82999:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac779 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.184894:0:82999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac779 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.184902:0:82999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac779 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.184910:0:82999:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac779 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316892.184956:0:82999:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff9cfe18fd6d80 x1853163894034304/t8589937427(8589937427) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767316892.184971:0:82999:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18fd6d80 x1853163894034304/t8589937427(8589937427) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316892.184988:0:82999:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac779 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.185030:0:82999:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 2 res 8589935621/144 (0 0) 00000080:00200000:3.0:1767316892.185038:0:82999:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000002:00100000:3.0:1767316892.185058:0:82999:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18fd6d80 x1853163894034304/t8589937427(8589937427) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1767316892.185067:0:82999:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56beb 00000080:00010000:3.0:1767316892.185074:0:82999:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56beb from it ffffa99f420f7cc0 00010000:00010000:3.0:1767316892.185463:0:82999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac779 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.185473:0:82999:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac779 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316892.185783:0:82999:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 4 00000080:00200000:3.0:1767316892.185796:0:82999:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), xattr lov 00000080:00200008:3.0:1767316892.185828:0:82999:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316892.185836:0:82999:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:3.0:1767316892.185859:0:82999:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316892.185870:0:82999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.185881:0:82999:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316892.185888:0:82999:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316892.185894:0:82999:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:3.0:1767316892.185898:0:82999:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bdd 00000080:00010000:3.0:1767316892.185910:0:82999:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bdd from it ffffa99f420f7cd8 00010000:00010000:3.0:1767316892.185913:0:82999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.185933:0:82999:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200080:3.0:1767316892.185995:0:82999:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=66f4 arg=1 00000080:00200080:3.0:1767316892.237351:0:82999:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=1 00000080:00200008:3.0:1767316892.237372:0:82999:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316892.237382:0:82999:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:3.0:1767316892.237532:0:82999:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316892.237549:0:82999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.237563:0:82999:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316892.237571:0:82999:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316892.237581:0:82999:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:3.0:1767316892.237584:0:82999:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bdd 00000080:00010000:3.0:1767316892.237590:0:82999:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bdd from it ffffa99f420f7cd8 00010000:00010000:3.0:1767316892.237594:0:82999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.237602:0:82999:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200008:3.0:1767316892.237636:0:82999:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:3.0:1767316892.237653:0:82999:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1767316892.237664:0:82999:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767316892.237667:0:82999:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1767316892.237762:0:82999:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316892.237773:0:82999:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:3.0:1767316892.237783:0:82999:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000020:00200000:3.0:1767316892.237791:0:82999:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:3.0:1767316892.237794:0:82999:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:3.0:1767316892.237796:0:82999:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:3.0:1767316892.237805:0:82999:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767316892.237813:0:82999:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:3.0:1767316892.237817:0:82999:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767316892.237835:0:82999:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:3.0:1767316892.237850:0:82999:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767316892.237855:0:82999:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aad30, osc lock ffff9cfe2004fa20, flags 0x40000 00000080:00200000:3.0:1767316892.237863:0:82999:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000001:00010000:3.0:1767316892.237870:0:82999:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1767316892.237875:0:82999:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767316892.237876:0:82999:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aa930, osc lock ffff9cfe2004e260, flags 0x400001002 00010000:00010000:3.0:1767316892.237889:0:82999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.237900:0:82999:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767316892.237914:0:82999:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316892.237934:0:82999:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767316892.237938:0:82999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.237952:0:82999:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316892.237962:0:82999:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316892.237971:0:82999:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:3.0:1767316892.237974:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d17230 (ffff9cfe0e4c8248/0) at cl_lock_release():245 00000020:00010000:3.0:1767316892.237977:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d17230 (ffff9cfe0e4c8248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.237980:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aa930 (ffff9cfe0e4c8128/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.237984:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d17230 (ffff9cfe0e4c8248/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316892.237987:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aa930 (ffff9cfe0e4c8248/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316892.237997:0:82999:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:3.0:1767316892.238186:0:82999:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:3.0:1767316892.238240:0:82999:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767316892.238242:0:82999:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:3.0:1767316892.238249:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_release():245 00000020:00010000:3.0:1767316892.238251:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.238254:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aad30 (ffff9cfe0e4c8128/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.238256:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316892.238258:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aad30 (ffff9cfe0e4c8248/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316892.238263:0:82999:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:3.0:1767316892.238269:0:82999:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767316892.238292:0:60911:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe02e89900 00000008:00100000:3.0:1767316892.238337:0:60911:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe18fd6680 - object 0x280000400:162 offset 0<>29 00000100:00100000:2.0:1767316892.238427:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894034432:192.168.202.121@tcp:3:lfs.0 00000008:00010000:2.0:1767316892.242761:0:2504:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe02e89900 00000020:00200000:2.0:1767316892.242776:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767316892.242783:0:2504:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:2.0:1767316892.242793:0:2504:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:2.0:1767316892.242805:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767316892.242865:0:2504:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe02e89900 00000100:00100000:2.0:1767316892.242891:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894034432:192.168.202.121@tcp:3:lfs.0 00000080:00200000:3.0:1767316892.242963:0:82999:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1767316892.242977:0:82999:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316892.242981:0:82999:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:3.0:1767316892.243098:0:82999:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316892.243107:0:82999:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:3.0:1767316892.243125:0:82999:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:3.0:1767316892.243163:0:82999:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=2 00000080:00200008:3.0:1767316892.243171:0:82999:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316892.243179:0:82999:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:3.0:1767316892.243271:0:82999:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316892.243288:0:82999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.243302:0:82999:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316892.243309:0:82999:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316892.243317:0:82999:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:3.0:1767316892.243321:0:82999:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bdd 00000080:00010000:3.0:1767316892.243327:0:82999:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bdd from it ffffa99f420f7cd8 00010000:00010000:3.0:1767316892.243331:0:82999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.243338:0:82999:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200008:3.0:1767316892.243364:0:82999:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:3.0:1767316892.243371:0:82999:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:3.0:1767316892.243381:0:82999:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767316892.243384:0:82999:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1767316892.243392:0:82999:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316892.243481:0:82999:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:3.0:1767316892.243497:0:82999:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:3.0:1767316892.243504:0:82999:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:3.0:1767316892.243505:0:82999:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:3.0:1767316892.243508:0:82999:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:3.0:1767316892.243516:0:82999:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767316892.243524:0:82999:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:3.0:1767316892.243527:0:82999:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:3.0:1767316892.243542:0:82999:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:3.0:1767316892.243554:0:82999:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767316892.243558:0:82999:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aad30, osc lock ffff9cfe2004fa20, flags 0x40000 00000080:00200000:3.0:1767316892.243565:0:82999:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:3.0:1767316892.243575:0:82999:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:3.0:1767316892.243581:0:82999:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:3.0:1767316892.243618:0:82999:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767316892.243620:0:82999:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:3.0:1767316892.243627:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_release():245 00000020:00010000:3.0:1767316892.243630:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.243633:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aad30 (ffff9cfe0e4c8128/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.243636:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316892.243638:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aad30 (ffff9cfe0e4c8248/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316892.243644:0:82999:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:3.0:1767316892.243647:0:82999:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767316892.243663:0:60911:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe02e89f00 00000008:00100000:3.0:1767316892.243775:0:60911:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe18fd7480 - object 0x2c0000400:161 offset 0<>29 00000100:00100000:2.0:1767316892.243844:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894034560:192.168.202.121@tcp:3:lfs.0 00000100:00100000:3.0:1767316892.246857:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316892.246890:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939795584 00000100:00100000:3.0:1767316892.246898:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939795584 00000100:00100000:3.0:1767316892.246952:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10210 00000100:00100000:3.0:1767316892.246962:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:41148:x1853163939795584:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316892.246978:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac72c expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.247400:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316892.247408:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:41148:x1853163939795584:12345-192.168.202.121@tcp:104: Request processed in 448us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316892.247417:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10210 00010000:00010000:0.0:1767316892.247510:0:63143:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316892.247518:0:63143:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac72c expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.247528:0:63143:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2ce00 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316892.247534:0:63143:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac72c expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.247579:0:63143:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac72c expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.247588:0:63143:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316892.247624:0:63143:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac72c expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.247632:0:63143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56bcf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac72c expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.247654:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316892.247656:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316892.247658:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316892.247799:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316892.247816:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894034688:192.168.202.121@tcp:103:ldlm_bl.0 00000008:00010000:3.0:1767316892.252888:0:2505:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe02e89f00 00000020:00200000:3.0:1767316892.252900:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316892.252908:0:2505:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767316892.252926:0:2505:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767316892.252939:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316892.252953:0:2505:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe02e89f00 00000100:00100000:3.0:1767316892.252979:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894034560:192.168.202.121@tcp:3:lfs.0 00000080:00200000:2.0:1767316892.253172:0:82999:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767316892.253196:0:82999:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316892.253201:0:82999:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:2.0:1767316892.253204:0:82999:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316892.253211:0:82999:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:2.0:1767316892.253228:0:82999:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:2.0:1767316892.253240:0:82999:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=3 00000080:00200008:2.0:1767316892.253247:0:82999:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316892.253254:0:82999:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:2.0:1767316892.253280:0:82999:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316892.253297:0:82999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.253310:0:82999:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316892.253317:0:82999:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316892.253324:0:82999:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:2.0:1767316892.253328:0:82999:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bdd 00000080:00010000:2.0:1767316892.253348:0:82999:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bdd from it ffffa99f420f7cd8 00010000:00010000:2.0:1767316892.253352:0:82999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.253361:0:82999:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767316892.253386:0:82999:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:2.0:1767316892.253394:0:82999:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:2.0:1767316892.253404:0:82999:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316892.253407:0:82999:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767316892.253414:0:82999:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316892.253420:0:82999:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767316892.253428:0:82999:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 3 00000020:00200000:2.0:1767316892.253435:0:82999:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767316892.253436:0:82999:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767316892.253438:0:82999:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:2.0:1767316892.253445:0:82999:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767316892.253452:0:82999:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767316892.253455:0:82999:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1767316892.253471:0:82999:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767316892.253485:0:82999:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767316892.253489:0:82999:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f6b0, osc lock ffff9cfe2013cab0, flags 0x40000 00000080:00200000:2.0:1767316892.253497:0:82999:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:2.0:1767316892.253508:0:82999:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:2.0:1767316892.253514:0:82999:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:2.0:1767316892.253555:0:82999:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316892.253558:0:82999:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:2.0:1767316892.253565:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_release():245 00000020:00010000:2.0:1767316892.253568:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.253571:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f6b0 (ffff9cfe0e4c8128/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.253580:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316892.253582:0:82999:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f6b0 (ffff9cfe0e4c8248/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316892.253589:0:82999:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:2.0:1767316892.253594:0:82999:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316892.253608:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000008:00100000:2.0:1767316892.253646:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe29109180 - object 0x280000400:163 offset 0<>29 00000100:00100000:3.0:1767316892.254012:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767316892.254031:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894034816:192.168.202.121@tcp:3:lfs.0 00000100:00100000:1.0:1767316892.255272:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894034688:192.168.202.121@tcp:103:ldlm_bl.0 00000008:00010000:3.0:1767316892.260785:0:2505:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000020:00200000:3.0:1767316892.260797:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316892.260805:0:2505:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767316892.260814:0:2505:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767316892.260827:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316892.260847:0:2505:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45ccc0 00000100:00100000:3.0:1767316892.260873:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894034816:192.168.202.121@tcp:3:lfs.0 00000080:00200000:2.0:1767316892.260973:0:82999:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767316892.260987:0:82999:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316892.260993:0:82999:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:2.0:1767316892.260997:0:82999:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316892.261016:0:82999:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:2.0:1767316892.261035:0:82999:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:0.0:1767316892.273127:0:82999:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=c00c66f3 arg=7fff45bf0e14 00010000:00010000:0.0:1767316892.273155:0:82999:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x863eb2f6655ac779 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.273227:0:82999:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 1/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x863eb2f6655ac779 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.273250:0:82999:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767316892.273279:0:82999:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82999:1853163894034944:192.168.202.121@tcp:103:lfs.0 00000100:00100000:0.0:1767316892.273384:0:82999:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316892.275857:0:82999:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82999:1853163894034944:192.168.202.121@tcp:103:lfs.0 00010000:00010000:0.0:1767316892.275888:0:82999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713a00/0xd9a0da65fad56beb lrc: 0/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x863eb2f6655ac779 expref: -99 pid: 82999 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316892.275956:0:82999:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18fd6d80 x1853163894034304/t8589937427(8589937427) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316892.275968:0:82999:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316892.275974:0:82999:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191db480 x1853163894035200/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316892.275994:0:82999:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82999:1853163894035200:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316892.276129:0:82999:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316892.279620:0:82999:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:82999:1853163894035200:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316892.279659:0:82999:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18fd6d80 x1853163894034304/t8589937427(8589937427) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316892.279707:0:82999:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 154000 00010000:00010000:0.0:1767316892.279732:0:82999:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.292884:0:83000:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316892.292930:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316892.292947:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.292963:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316892.292971:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316892.292978:0:83000:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316892.292982:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:1.0:1767316892.292989:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f41667b58 00010000:00010000:1.0:1767316892.292993:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.293001:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316892.293015:0:83000:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316892.293022:0:83000:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=9 00000080:00200008:1.0:1767316892.293030:0:83000:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316892.293035:0:83000:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316892.293048:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316892.293061:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.293069:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.293075:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316892.293103:0:83000:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316892.293107:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bdd 00000080:00010000:1.0:1767316892.293111:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bdd from it ffffa99f41667cb8 00010000:00010000:1.0:1767316892.293114:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.293120:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.293147:0:83000:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316892.293155:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316892.293160:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.293167:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316892.293173:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316892.293177:0:83000:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316892.293179:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:1.0:1767316892.293182:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f41667bf8 00010000:00010000:1.0:1767316892.293185:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.293198:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316892.293207:0:83000:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316892.293212:0:83000:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:1.0:1767316892.293215:0:83000:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 44 00000080:00200008:1.0:1767316892.293220:0:83000:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 154400 00000080:00200080:1.0:1767316892.293255:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=c00c66f3 arg=7ffe7979cb04 00000002:00010000:1.0:1767316892.293270:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 01004040000001 00010000:00010000:1.0:1767316892.293320:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 83000 initiator: MDT0 00010000:00010000:1.0:1767316892.294736:0:83000:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 83000 initiator: MDT0 00000020:00100000:1.0:1767316892.294824:0:83000:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316892.294846:0:83000:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3e300 x1853163894035456/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316892.294858:0:83000:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x81000000000000 pid: 83000 initiator: MDT0 00000100:00100000:1.0:1767316892.294889:0:83000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894035456:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316892.295232:0:83000:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1767316892.307681:0:83000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894035456:192.168.202.121@tcp:101:lfs.0 00010000:00010000:3.0:1767316892.307710:0:83000:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac7a3 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.307723:0:83000:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac7a3 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.307766:0:83000:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac7a3 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.307777:0:83000:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac7a3 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.307791:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac7a3 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.307798:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac7a3 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.307806:0:83000:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac7a3 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316892.307816:0:83000:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff9cfe18f3e300 x1853163894035456/t8589937429(8589937429) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767316892.307828:0:83000:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3e300 x1853163894035456/t8589937429(8589937429) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316892.307843:0:83000:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac7a3 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.307856:0:83000:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 2 res 8589935621/144 (0 0) 00000080:00200000:3.0:1767316892.307863:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000002:00100000:3.0:1767316892.307882:0:83000:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3e300 x1853163894035456/t8589937429(8589937429) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1767316892.307900:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bf2 00000080:00010000:3.0:1767316892.307907:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bf2 from it ffffa99f41667cc0 00010000:00010000:3.0:1767316892.307911:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac7a3 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.307929:0:83000:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac7a3 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316892.308188:0:83000:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 4 00000080:00200000:3.0:1767316892.308198:0:83000:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), xattr lov 00000080:00200008:3.0:1767316892.308231:0:83000:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316892.308238:0:83000:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:3.0:1767316892.308261:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316892.308270:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.308280:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316892.308286:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316892.308291:0:83000:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:3.0:1767316892.308294:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bdd 00000080:00010000:3.0:1767316892.308298:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bdd from it ffffa99f41667cd8 00010000:00010000:3.0:1767316892.308301:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.308309:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200080:3.0:1767316892.308865:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=66f4 arg=1 00000080:00200080:2.0:1767316892.371626:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=1 00000080:00200008:2.0:1767316892.371647:0:83000:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316892.371656:0:83000:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:2.0:1767316892.371847:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316892.371868:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.371885:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316892.371894:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316892.371904:0:83000:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:2.0:1767316892.371908:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bdd 00000080:00010000:2.0:1767316892.371925:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bdd from it ffffa99f41667cd8 00010000:00010000:2.0:1767316892.371930:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.371950:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767316892.371984:0:83000:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:2.0:1767316892.371995:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:2.0:1767316892.372006:0:83000:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316892.372009:0:83000:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767316892.372021:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316892.372030:0:83000:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767316892.372039:0:83000:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000020:00200000:2.0:1767316892.372047:0:83000:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767316892.372049:0:83000:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767316892.372051:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:2.0:1767316892.372059:0:83000:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767316892.372066:0:83000:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767316892.372070:0:83000:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316892.372178:0:83000:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767316892.372195:0:83000:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767316892.372200:0:83000:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f6b0, osc lock ffff9cfe2013cab0, flags 0x40000 00000080:00200000:2.0:1767316892.372209:0:83000:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:2.0:1767316892.372222:0:83000:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:2.0:1767316892.372229:0:83000:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:2.0:1767316892.372290:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316892.372294:0:83000:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:2.0:1767316892.372301:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_release():245 00000020:00010000:2.0:1767316892.372304:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.372307:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f6b0 (ffff9cfe0e4c8128/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.372310:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316892.372313:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f6b0 (ffff9cfe0e4c8248/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316892.372327:0:83000:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:2.0:1767316892.372333:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316892.372360:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45cf00 00000008:00100000:2.0:1767316892.372402:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe2910a680 - object 0x280000400:162 offset 0<>29 00000100:00100000:3.0:1767316892.372470:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894035584:192.168.202.121@tcp:3:lfs.0 00000008:00010000:3.0:1767316892.375425:0:2505:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45cf00 00000020:00200000:3.0:1767316892.375437:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316892.375445:0:2505:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767316892.375453:0:2505:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767316892.375464:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316892.375485:0:2505:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45cf00 00000100:00100000:3.0:1767316892.375509:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894035584:192.168.202.121@tcp:3:lfs.0 00000080:00200000:2.0:1767316892.376043:0:83000:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767316892.376055:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316892.376060:0:83000:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:2.0:1767316892.376063:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316892.376074:0:83000:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:2.0:1767316892.376128:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:2.0:1767316892.376168:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=2 00000080:00200008:2.0:1767316892.376176:0:83000:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316892.376184:0:83000:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:2.0:1767316892.376212:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316892.376231:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.376244:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316892.376251:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316892.376259:0:83000:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:2.0:1767316892.376263:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bdd 00000080:00010000:2.0:1767316892.376270:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bdd from it ffffa99f41667cd8 00010000:00010000:2.0:1767316892.376274:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.376281:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767316892.376327:0:83000:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:2.0:1767316892.376333:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:2.0:1767316892.376344:0:83000:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316892.376347:0:83000:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767316892.376354:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316892.376361:0:83000:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767316892.376370:0:83000:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:2.0:1767316892.376377:0:83000:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767316892.376379:0:83000:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767316892.376381:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:2.0:1767316892.376388:0:83000:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767316892.376394:0:83000:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767316892.376397:0:83000:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:2.0:1767316892.376411:0:83000:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767316892.376423:0:83000:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767316892.376428:0:83000:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f6b0, osc lock ffff9cfe2013cab0, flags 0x40000 00000080:00200000:2.0:1767316892.376434:0:83000:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:2.0:1767316892.376444:0:83000:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:2.0:1767316892.376450:0:83000:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:2.0:1767316892.376491:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316892.376494:0:83000:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:2.0:1767316892.376500:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_release():245 00000020:00010000:2.0:1767316892.376503:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.376506:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f6b0 (ffff9cfe0e4c8128/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.376509:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316892.376511:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f6b0 (ffff9cfe0e4c8248/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316892.376518:0:83000:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:2.0:1767316892.376523:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316892.376538:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45cd80 00000008:00100000:2.0:1767316892.376587:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe2910ad80 - object 0x2c0000400:161 offset 0<>29 00000100:00100000:3.0:1767316892.376654:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894035712:192.168.202.121@tcp:3:lfs.0 00000008:00010000:3.0:1767316892.381984:0:2504:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45cd80 00000020:00200000:3.0:1767316892.381996:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316892.382290:0:2504:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767316892.382298:0:2504:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:2.0:1767316892.382399:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767316892.382455:0:2504:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45cd80 00000100:00100000:2.0:1767316892.382481:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894035712:192.168.202.121@tcp:3:lfs.0 00000080:00200000:0.0:1767316892.382546:0:83000:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767316892.382560:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316892.382565:0:83000:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:0.0:1767316892.382581:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316892.382590:0:83000:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:0.0:1767316892.382608:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:0.0:1767316892.382622:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=3 00000080:00200008:0.0:1767316892.382628:0:83000:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316892.382636:0:83000:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:0.0:1767316892.382661:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316892.382749:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.382990:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316892.383072:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316892.383097:0:83000:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316892.383100:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bdd 00000080:00010000:0.0:1767316892.383107:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bdd from it ffffa99f41667cd8 00010000:00010000:0.0:1767316892.383109:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.383116:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316892.383139:0:83000:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:0.0:1767316892.383144:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:0.0:1767316892.383153:0:83000:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316892.383155:0:83000:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:0.0:1767316892.383161:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316892.383166:0:83000:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:0.0:1767316892.383178:0:83000:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 3 00000020:00200000:0.0:1767316892.383255:0:83000:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:0.0:1767316892.383258:0:83000:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:0.0:1767316892.383261:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:0.0:1767316892.383270:0:83000:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1767316892.383279:0:83000:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:0.0:1767316892.383283:0:83000:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1767316892.383301:0:83000:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:0.0:1767316892.383316:0:83000:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:0.0:1767316892.383321:0:83000:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc99b0, osc lock ffff9cfe201daf70, flags 0x40000 00000080:00200000:0.0:1767316892.383329:0:83000:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:0.0:1767316892.383341:0:83000:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:0.0:1767316892.383349:0:83000:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:0.0:1767316892.383392:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1767316892.383395:0:83000:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:0.0:1767316892.383401:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_release():245 00000020:00010000:0.0:1767316892.383403:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.383406:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc99b0 (ffff9cfe0e4c8128/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.383408:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316892.383410:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc99b0 (ffff9cfe0e4c8248/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316892.383415:0:83000:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:0.0:1767316892.383418:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1767316892.383433:0:49615:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe21417c00 00000008:00100000:0.0:1767316892.383472:0:49615:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe191db480 - object 0x280000400:163 offset 0<>29 00000100:00100000:1.0:1767316892.383535:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894035840:192.168.202.121@tcp:3:lfs.0 00000008:00010000:1.0:1767316892.387101:0:2502:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe21417c00 00000020:00200000:1.0:1767316892.387114:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:1.0:1767316892.387122:0:2502:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:1.0:1767316892.387145:0:2502:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:1.0:1767316892.387156:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:1.0:1767316892.387178:0:2502:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe21417c00 00000100:00100000:1.0:1767316892.387208:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894035840:192.168.202.121@tcp:3:lfs.0 00000080:00200000:0.0:1767316892.387478:0:83000:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767316892.387493:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316892.387498:0:83000:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:0.0:1767316892.387501:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316892.387509:0:83000:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:0.0:1767316892.387528:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:2.0:1767316892.472315:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=1 00000080:00200008:2.0:1767316892.472338:0:83000:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316892.472349:0:83000:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:2.0:1767316892.472383:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316892.472403:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.472419:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316892.472426:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316892.472521:0:83000:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:2.0:1767316892.472526:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bdd 00000080:00010000:2.0:1767316892.472533:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bdd from it ffffa99f41667cd8 00010000:00010000:2.0:1767316892.472536:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.472545:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767316892.472576:0:83000:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 67108864 00000080:00200000:2.0:1767316892.472588:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767316892.472601:0:83000:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316892.472604:0:83000:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767316892.472626:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316892.472632:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:2.0:1767316892.472637:0:83000:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316892.472639:0:83000:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767316892.472642:0:83000:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:2.0:1767316892.472665:0:83000:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316892.472670:0:83000:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f6b0, osc lock ffff9cfe2013cab0, flags 0x400000400001002 00010000:00010000:2.0:1767316892.472689:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316892.472700:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316892.472712:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316892.472716:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316892.472725:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316892.472736:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316892.472743:0:83000:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:2.0:1767316892.472747:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:2.0:1767316892.472751:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.472754:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f6b0 (ffff9cfe0e4c8d88/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.472759:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316892.472762:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f6b0 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316892.472772:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316892.472784:0:83000:0:(file.c:2367:file_read_confine_iter()) f212b.sanity-flr: read [0, 67108864] over eof, kms 29, file_size 29. 00000080:00200000:2.0:1767316892.472792:0:83000:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767316892.472800:0:83000:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000020:00200000:2.0:1767316892.472807:0:83000:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767316892.472809:0:83000:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767316892.472812:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:2.0:1767316892.472821:0:83000:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767316892.472827:0:83000:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767316892.472831:0:83000:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316892.472844:0:83000:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767316892.472852:0:83000:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767316892.472855:0:83000:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f6b0, osc lock ffff9cfe2013cab0, flags 0x40000 00000080:00200000:2.0:1767316892.472861:0:83000:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:2.0:1767316892.472871:0:83000:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:2.0:1767316892.472876:0:83000:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:2.0:1767316892.472935:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316892.472938:0:83000:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:2.0:1767316892.472944:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102846c8 (ffff9cfe0e4c85a8/0) at cl_lock_release():245 00000020:00010000:2.0:1767316892.472946:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102846c8 (ffff9cfe0e4c85a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.472949:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f6b0 (ffff9cfe0e4c8098/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.472951:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102846c8 (ffff9cfe0e4c85a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316892.472953:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f6b0 (ffff9cfe0e4c85a8/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316892.472958:0:83000:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:2.0:1767316892.472962:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316892.473153:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45cd80 00000008:00100000:2.0:1767316892.473291:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe2910ad80 - object 0x280000400:162 offset 0<>29 00000100:00100000:3.0:1767316892.473377:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894035968:192.168.202.121@tcp:3:lfs.0 00000008:00010000:3.0:1767316892.479960:0:2505:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45cd80 00000020:00200000:3.0:1767316892.480065:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316892.480075:0:2505:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767316892.480100:0:2505:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767316892.480116:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316892.480199:0:2505:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45cd80 00000100:00100000:3.0:1767316892.480226:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894035968:192.168.202.121@tcp:3:lfs.0 00000080:00200000:2.0:1767316892.486113:0:83000:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767316892.486137:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316892.486143:0:83000:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:2.0:1767316892.486148:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316892.490125:0:83000:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:3.0:1767316892.490160:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:3.0:1767316892.490176:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=2 00000080:00200008:3.0:1767316892.490184:0:83000:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316892.490213:0:83000:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:3.0:1767316892.490241:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316892.490258:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.490273:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316892.490280:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316892.490288:0:83000:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:3.0:1767316892.490291:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bdd 00000080:00010000:3.0:1767316892.490297:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bdd from it ffffa99f41667cd8 00010000:00010000:3.0:1767316892.490301:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.490308:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200008:3.0:1767316892.490335:0:83000:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 67108864 00000080:00200000:3.0:1767316892.490345:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:3.0:1767316892.490357:0:83000:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767316892.490360:0:83000:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1767316892.490371:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316892.490377:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1767316892.490381:0:83000:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767316892.490383:0:83000:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767316892.490386:0:83000:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1767316892.490409:0:83000:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767316892.490418:0:83000:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aad30, osc lock ffff9cfe2004fa20, flags 0x400000400001002 00010000:00010000:3.0:1767316892.490436:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.490447:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316892.490459:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767316892.490463:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.490471:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316892.490481:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316892.490488:0:83000:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:3.0:1767316892.490492:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d17908 (ffff9cfe0e4c8488/0) at cl_lock_release():245 00000020:00010000:3.0:1767316892.490495:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d17908 (ffff9cfe0e4c8488/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.490497:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aad30 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.490501:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d17908 (ffff9cfe0e4c8488/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316892.490504:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aad30 (ffff9cfe0e4c8488/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316892.490513:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316892.490517:0:83000:0:(file.c:2367:file_read_confine_iter()) f212b.sanity-flr: read [0, 67108864] over eof, kms 29, file_size 29. 00000080:00200000:3.0:1767316892.490524:0:83000:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:3.0:1767316892.490532:0:83000:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:3.0:1767316892.490539:0:83000:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:3.0:1767316892.490541:0:83000:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:3.0:1767316892.490544:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:3.0:1767316892.490552:0:83000:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767316892.490566:0:83000:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:3.0:1767316892.490570:0:83000:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:3.0:1767316892.492220:0:83000:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:3.0:1767316892.492242:0:83000:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767316892.492246:0:83000:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aad30, osc lock ffff9cfe2004fa20, flags 0x40000 00000080:00200000:3.0:1767316892.492254:0:83000:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:3.0:1767316892.492271:0:83000:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:3.0:1767316892.492279:0:83000:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:3.0:1767316892.493531:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767316892.493538:0:83000:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:3.0:1767316892.493549:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102846c8 (ffff9cfe0e4c85a8/0) at cl_lock_release():245 00000020:00010000:3.0:1767316892.493553:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102846c8 (ffff9cfe0e4c85a8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.493557:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aad30 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.493852:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102846c8 (ffff9cfe0e4c85a8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316892.493856:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aad30 (ffff9cfe0e4c85a8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316892.493867:0:83000:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:3.0:1767316892.493874:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767316892.494110:0:60911:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe02e89f00 00000008:00100000:3.0:1767316892.494164:0:60911:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe18fd7480 - object 0x2c0000400:161 offset 0<>29 00000100:00100000:3.0:1767316892.494213:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894036096:192.168.202.121@tcp:3:lfs.0 00000008:00010000:3.0:1767316892.506201:0:2504:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe02e89f00 00000020:00200000:3.0:1767316892.506214:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316892.506221:0:2504:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767316892.506229:0:2504:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767316892.506241:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316892.506260:0:2504:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe02e89f00 00000100:00100000:3.0:1767316892.506285:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894036096:192.168.202.121@tcp:3:lfs.0 00000080:00200000:2.0:1767316892.506570:0:83000:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767316892.507008:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316892.507013:0:83000:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:2.0:1767316892.507016:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316892.507028:0:83000:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:2.0:1767316892.507048:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:2.0:1767316892.507062:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=3 00000080:00200008:2.0:1767316892.507070:0:83000:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316892.507077:0:83000:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:2.0:1767316892.507150:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316892.507167:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.507183:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316892.507191:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316892.507200:0:83000:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:2.0:1767316892.507203:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bdd 00000080:00010000:2.0:1767316892.507210:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bdd from it ffffa99f41667cd8 00010000:00010000:2.0:1767316892.507213:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.507222:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767316892.507250:0:83000:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 67108864 00000080:00200000:2.0:1767316892.507259:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:2.0:1767316892.507270:0:83000:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316892.507274:0:83000:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767316892.507289:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316892.507295:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 8 restore needed 0 00020000:00200000:2.0:1767316892.507299:0:83000:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316892.507301:0:83000:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767316892.507303:0:83000:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:2.0:1767316892.507536:0:83000:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316892.507541:0:83000:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f6b0, osc lock ffff9cfe2013cab0, flags 0x400000400001002 00010000:00010000:2.0:1767316892.507561:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.509876:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316892.510106:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767316892.510112:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.510122:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316892.510143:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316892.510159:0:83000:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:3.0:1767316892.510164:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d17908 (ffff9cfe0e4c8488/0) at cl_lock_release():245 00000020:00010000:3.0:1767316892.510168:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d17908 (ffff9cfe0e4c8488/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.510173:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f6b0 (ffff9cfe0e4c8098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.510178:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d17908 (ffff9cfe0e4c8488/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316892.510180:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f6b0 (ffff9cfe0e4c8488/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316892.510195:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316892.510202:0:83000:0:(file.c:2367:file_read_confine_iter()) f212b.sanity-flr: read [0, 67108864] over eof, kms 29, file_size 29. 00000080:00200000:3.0:1767316892.510210:0:83000:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:3.0:1767316892.510220:0:83000:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 3 00000020:00200000:3.0:1767316892.510227:0:83000:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:3.0:1767316892.510229:0:83000:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:3.0:1767316892.510233:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00000080:00200000:3.0:1767316892.510248:0:83000:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767316892.510256:0:83000:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:3.0:1767316892.510260:0:83000:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:3.0:1767316892.510279:0:83000:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:3.0:1767316892.510294:0:83000:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767316892.510298:0:83000:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aad30, osc lock ffff9cfe2004fa20, flags 0x40000 00000080:00200000:3.0:1767316892.510305:0:83000:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:3.0:1767316892.510323:0:83000:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:3.0:1767316892.510330:0:83000:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:3.0:1767316892.511254:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767316892.511258:0:83000:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:3.0:1767316892.511265:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe102846c8 (ffff9cfe0e4c85a8/0) at cl_lock_release():245 00000020:00010000:3.0:1767316892.511269:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe102846c8 (ffff9cfe0e4c85a8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.511271:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aad30 (ffff9cfe0e4c8488/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.511274:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe102846c8 (ffff9cfe0e4c85a8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316892.511276:0:83000:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aad30 (ffff9cfe0e4c85a8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316892.511487:0:83000:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:3.0:1767316892.511494:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767316892.511542:0:60911:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe02e89f00 00000008:00100000:3.0:1767316892.511694:0:60911:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe18fd7480 - object 0x280000400:163 offset 0<>29 00000100:00100000:3.0:1767316892.511745:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894036224:192.168.202.121@tcp:3:lfs.0 00000008:00010000:3.0:1767316892.518696:0:2505:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe02e89f00 00000020:00200000:3.0:1767316892.518711:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316892.518718:0:2505:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767316892.518726:0:2505:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767316892.518737:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316892.518755:0:2505:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe02e89f00 00000100:00100000:3.0:1767316892.518780:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894036224:192.168.202.121@tcp:3:lfs.0 00000080:00200000:2.0:1767316892.518800:0:83000:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767316892.518817:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316892.518823:0:83000:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:2.0:1767316892.518828:0:83000:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316892.518839:0:83000:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:3.0:1767316892.519364:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200000:0.0:1767316892.550188:0:83000:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316892.550223:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316892.550253:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.550268:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316892.550276:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316892.550284:0:83000:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316892.550288:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:0.0:1767316892.550295:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f41667bf8 00010000:00010000:0.0:1767316892.550309:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.550320:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316892.550335:0:83000:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316892.550343:0:83000:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:0.0:1767316892.550349:0:83000:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 44 00000080:00200008:0.0:1767316892.550356:0:83000:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 154400 00000002:00010000:0.0:1767316892.550369:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114401 00010000:00010000:0.0:1767316892.550416:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83000 initiator: MDT0 00010000:00010000:0.0:1767316892.550424:0:83000:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83000 initiator: MDT0 00000020:00100000:0.0:1767316892.550436:0:83000:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316892.550448:0:83000:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191daa00 x1853163894036480/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316892.550472:0:83000:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83000 initiator: MDT0 00000100:00100000:0.0:1767316892.550495:0:83000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894036480:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316892.550692:0:83000:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316892.556850:0:83000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894036480:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316892.556979:0:83000:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.556991:0:83000:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.557456:0:83000:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.557469:0:83000:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316892.557487:0:83000:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe191daa00 x1853163894036480/t8589937430(8589937430) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316892.557500:0:83000:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191daa00 x1853163894036480/t8589937430(8589937430) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316892.557513:0:83000:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316892.557529:0:83000:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.557559:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.557571:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.557590:0:83000:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.557602:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.557609:0:83000:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.557629:0:83000:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:0.0:1767316892.557635:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316892.557690:0:83000:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:0.0:1767316892.557708:0:83000:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 8 -> 8 00000080:00010000:0.0:1767316892.557714:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56be4 00000080:00010000:0.0:1767316892.557720:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56be4 from it ffffa99f41667bf0 00010000:00010000:0.0:1767316892.557724:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.557733:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316892.557759:0:83000:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191daa00 x1853163894036480/t8589937430(8589937430) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316892.557907:0:83000:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1767316892.557925:0:83000:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), xattr lov 00000080:00200008:0.0:1767316892.557949:0:83000:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316892.557956:0:83000:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:0.0:1767316892.557977:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316892.557985:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.557994:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316892.558014:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316892.558020:0:83000:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316892.558024:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56bdd 00000080:00010000:0.0:1767316892.558027:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56bdd from it ffffa99f41667cd8 00010000:00010000:0.0:1767316892.558031:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.558037:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316892.558072:0:83000:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 154000 00010000:00010000:0.0:1767316892.558121:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316892.558163:0:83000:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316892.558172:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316892.558186:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.558194:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316892.558200:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316892.558205:0:83000:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316892.558208:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:0.0:1767316892.558212:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f41667bf8 00010000:00010000:0.0:1767316892.558215:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.558223:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316892.558232:0:83000:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316892.558238:0:83000:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:0.0:1767316892.558243:0:83000:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 46 00000080:00200008:0.0:1767316892.558250:0:83000:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 100002 00000002:00010000:0.0:1767316892.558264:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 04240100003 00010000:00010000:0.0:1767316892.558275:0:83000:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x81008400000000 nid: local remote: 0x863eb2f6655ac7a3 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.558312:0:83000:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x863eb2f6655ac7a3 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.558319:0:83000:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316892.558321:0:83000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56bf2 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x863eb2f6655ac7a3 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.558371:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83000 initiator: MDT0 00010000:00010000:0.0:1767316892.558378:0:83000:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83000 initiator: MDT0 00000020:00100000:0.0:1767316892.558387:0:83000:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316892.558394:0:83000:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9500 x1853163894036736/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316892.558403:0:83000:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83000 initiator: MDT0 00000100:00100000:0.0:1767316892.558423:0:83000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894036736:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316892.558586:0:83000:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b600 going to sleep for 11 seconds 00010000:00010000:1.0:1767316892.558666:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316892.558673:0:59093:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.558681:0:59093:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316892.558686:0:59093:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.558694:0:59093:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.558701:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.558717:0:59093:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.558738:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.558744:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316892.558770:0:59093:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.558777:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56bf9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac7e2 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.558800:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316892.558801:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316892.558803:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316892.558810:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316892.558822:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894036864:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316892.561962:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316892.562044:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939795712 00000100:00100000:2.0:1767316892.562053:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939795712 00000100:00100000:2.0:1767316892.562131:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10211 00000100:00100000:2.0:1767316892.562141:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939795712:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316892.562156:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.562223:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316892.562229:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939795712:12345-192.168.202.121@tcp:104: Request processed in 89us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316892.562236:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10211 00010000:00010000:1.0:1767316892.562346:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316892.562353:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.562362:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05095000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316892.562366:0:42049:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.562374:0:42049:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.562382:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.562404:0:42049:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.562442:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 2/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.562449:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316892.562466:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.562493:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56bdd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac756 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.562509:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316892.562510:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316892.562512:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316892.562533:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894036992:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316892.568240:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894036864:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316892.568666:0:83000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894036736:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316892.568700:0:83000:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.568717:0:83000:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.568725:0:83000:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.568738:0:83000:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.568751:0:83000:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.568781:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.568790:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.568797:0:83000:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316892.568809:0:83000:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe191d9500 x1853163894036736/t8589937431(8589937431) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316892.568822:0:83000:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d9500 x1853163894036736/t8589937431(8589937431) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316892.568838:0:83000:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.568849:0:83000:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 8 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767316892.568858:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316892.568927:0:83000:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00010000:0.0:1767316892.568933:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c00 00000080:00010000:0.0:1767316892.568940:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c00 from it ffffa99f41667bf0 00010000:00010000:0.0:1767316892.568944:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.568952:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316892.568992:0:83000:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d9500 x1853163894036736/t8589937431(8589937431) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316892.569130:0:83000:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1767316892.569139:0:83000:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), xattr lov 00000080:00200008:0.0:1767316892.569164:0:83000:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316892.569171:0:83000:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:0.0:1767316892.569187:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316892.569195:0:83000:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:0.0:1767316892.569231:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 83000 initiator: MDT0 00010000:00010000:0.0:1767316892.569238:0:83000:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 83000 initiator: MDT0 00010000:00010000:0.0:1767316892.569247:0:83000:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 83000 initiator: MDT0 00000100:00100000:0.0:1767316892.569266:0:83000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894037120:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316892.569334:0:83000:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316892.570420:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894036992:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316892.571550:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316892.571648:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939795840 00000100:00100000:3.0:1767316892.571668:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939795840 00000100:00100000:3.0:1767316892.571723:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10212 00000100:00100000:3.0:1767316892.571734:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939795840:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316892.571758:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.571856:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316892.571864:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939795840:12345-192.168.202.121@tcp:104: Request processed in 132us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316892.571871:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10212 00010000:00010000:0.0:1767316892.572189:0:63840:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316892.572197:0:63840:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.572208:0:63840:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037d200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316892.572213:0:63840:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.572222:0:63840:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.572241:0:63840:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.572273:0:63840:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.572310:0:63840:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.572317:0:63840:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316892.572346:0:63840:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 1/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.572353:0:63840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c00 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac7f7 expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.572368:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316892.572370:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316892.572371:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316892.572639:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894037248:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316892.580340:0:83000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894037120:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316892.580370:0:83000:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.580383:0:83000:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.580397:0:83000:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.580428:0:83000:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.580441:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.580450:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.580456:0:83000:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316892.580468:0:83000:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191dad80 x1853163894037120/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/928 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316892.580481:0:83000:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316892.580493:0:83000:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.580506:0:83000:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767316892.580513:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316892.580570:0:83000:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:0.0:1767316892.580587:0:83000:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 8 -> 8 00000080:00010000:0.0:1767316892.580593:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c07 00000080:00010000:0.0:1767316892.580609:0:83000:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316892.580612:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c07 from it ffffa99f41667cd8 00010000:00010000:0.0:1767316892.580623:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.580630:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00000080:00200080:0.0:1767316892.580702:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=801066da arg=7ffe7979c910 00000080:00200000:0.0:1767316892.580717:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:0.0:1767316892.580728:0:83000:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316892.580731:0:83000:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316892.580737:0:83000:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:1.0:1767316892.580969:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894037248:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316892.580988:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316892.580998:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894037376:192.168.202.121@tcp:1:lfs.0 00000100:00100000:2.0:1767316892.584153:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316892.584405:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939795968 00000100:00100000:3.0:1767316892.584415:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939795968 00000100:00100000:3.0:1767316892.584469:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10213 00000100:00100000:3.0:1767316892.584479:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:48909:x1853163939795968:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316892.584494:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.584569:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316892.584576:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:48909:x1853163939795968:12345-192.168.202.121@tcp:104: Request processed in 99us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316892.584584:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10213 00010000:00010000:0.0:1767316892.584812:0:42048:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316892.584820:0:42048:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.584830:0:42048:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c000 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316892.584836:0:42048:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316892.584856:0:42048:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767316892.584869:0:42048:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1767316892.584931:0:42048:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.584939:0:42048:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316892.584969:0:42048:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.584989:0:42048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56bc8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac717 expref: -99 pid: 82998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.585012:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316892.585014:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316892.585015:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316892.585166:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894037504:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316892.593453:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894037504:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316892.600957:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894037376:192.168.202.121@tcp:1:lfs.0 00000080:00200000:0.0:1767316892.601161:0:83000:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 2 00000080:00200000:0.0:1767316892.601180:0:83000:0:(xattr.c:406:ll_xattr_set()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), xattr lov.set.flags 00010000:00010000:0.0:1767316892.601227:0:83000:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b19 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ac52d expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.601289:0:83000:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b19 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac52d expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.601297:0:83000:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316892.601300:0:83000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712c00/0xd9a0da65fad56b19 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac52d expref: -99 pid: 82847 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316892.601319:0:83000:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316892.601328:0:83000:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191dbb80 x1853163894037760/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 624/440 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316892.601356:0:83000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894037760:192.168.202.121@tcp:36:lfs.0 00000100:00100000:0.0:1767316892.601462:0:83000:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b600 going to sleep for 11 seconds 00000100:00100000:3.0:1767316892.603850:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316892.604025:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939796096 00000100:00100000:2.0:1767316892.604037:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939796096 00000100:00100000:2.0:1767316892.604120:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10214 00000100:00100000:2.0:1767316892.604130:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939796096:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316892.604147:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.604216:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316892.604223:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939796096:12345-192.168.202.121@tcp:104: Request processed in 95us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316892.604230:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10214 00010000:00010000:0.0:1767316892.604390:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316892.604398:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.604424:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe27713000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316892.604429:0:63142:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.604438:0:63142:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.604446:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.604471:0:63142:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316892.604519:0:63142:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191daa00 x1853163894036480/t8589937430(8589937430) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316892.604531:0:63142:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1767316892.604537:0:63142:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191db100 x1853163894038016/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316892.604560:0:63142:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_05:9a586faf-b087-472d-9665-d3bc7d15b908:63142:1853163894038016:192.168.202.121@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1767316892.604621:0:63142:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1767316892.604727:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316892.604803:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316892.605440:0:42040:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767316892.605454:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939796224 00000100:00100000:2.0:1767316892.605460:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939796224 00000100:00100000:2.0:1767316892.605495:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939796352 00000100:00100000:2.0:1767316892.605499:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939796352 00000100:00100000:2.0:1767316892.605513:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10215 00000100:00100000:2.0:1767316892.605520:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+6:15467:x1853163939796224:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316892.605531:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.605585:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316892.605591:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+6:15467:x1853163939796224:12345-192.168.202.121@tcp:104: Request processed in 72us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316892.605598:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10215 00000100:00100000:2.0:1767316892.605611:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10216 00000100:00100000:2.0:1767316892.605617:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe28139450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939796352:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316892.605634:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.605706:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1767316892.605713:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe28139450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939796352:12345-192.168.202.121@tcp:104: Request processed in 96us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316892.605719:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10216 00000100:00100000:3.0:1767316892.610416:0:63142:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_05:9a586faf-b087-472d-9665-d3bc7d15b908:63142:1853163894038016:192.168.202.121@tcp:35:ldlm_bl.0 00000002:00100000:3.0:1767316892.610454:0:63142:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191daa00 x1853163894036480/t8589937430(8589937430) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1767316892.610496:0:63142:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610546:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610569:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767316892.610605:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610613:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56be4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0xd rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac764 expref: -99 pid: 82999 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610629:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1767316892.610633:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610640:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2cc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:3.0:1767316892.610644:0:63142:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610653:0:63142:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610660:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610680:0:63142:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610695:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610701:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767316892.610706:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610717:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56bd6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac73a expref: -99 pid: 82998 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610727:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1767316892.610730:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610736:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037d400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:3.0:1767316892.610739:0:63142:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610744:0:63142:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610751:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316892.610767:0:63142:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:3.0:1767316892.610786:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610792:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767316892.610797:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610804:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56c07 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac80c expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.610817:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767316892.610825:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316892.610873:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894038144:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316892.610977:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894038400:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316892.611000:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767316892.611005:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894038272:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767316892.611427:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316892.611487:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767316892.612042:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767316892.623820:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894038272:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316892.623839:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894038144:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316892.623846:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894038400:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316892.624063:0:83000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894037760:192.168.202.121@tcp:36:lfs.0 00000080:00200008:0.0:1767316892.624201:0:83000:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 100002 00000002:00100000:0.0:1767316892.624271:0:83000:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191d9500 x1853163894036736/t8589937431(8589937431) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316892.624301:0:83000:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316892.624307:0:83000:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191da300 x1853163894038656/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316892.624328:0:83000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894038656:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316892.624456:0:83000:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b600 going to sleep for 11 seconds 00000100:00100000:0.0:1767316892.630163:0:83000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894038656:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316892.630201:0:83000:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191d9500 x1853163894036736/t8589937431(8589937431) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:0.0:1767316892.630298:0:83000:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=c00c66f3 arg=7ffe7979cb14 00000002:00100000:0.0:1767316892.630345:0:83000:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3e300 x1853163894035456/t8589937429(8589937429) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316892.630355:0:83000:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316892.630360:0:83000:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191da300 x1853163894038912/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316892.630379:0:83000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894038912:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316892.630459:0:83000:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b600 going to sleep for 11 seconds 00000100:00100000:0.0:1767316892.636370:0:83000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894038912:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316892.636408:0:83000:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3e300 x1853163894035456/t8589937429(8589937429) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767316892.636450:0:83000:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000002:00010000:0.0:1767316892.636462:0:83000:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:0.0:1767316892.636513:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83000 initiator: MDT0 00010000:00010000:0.0:1767316892.636536:0:83000:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83000 initiator: MDT0 00010000:00010000:0.0:1767316892.636546:0:83000:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83000 initiator: MDT0 00000100:00100000:0.0:1767316892.636566:0:83000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894039040:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316892.636698:0:83000:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b600 going to sleep for 11 seconds 00000100:00100000:0.0:1767316892.638960:0:83000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894039040:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316892.638990:0:83000:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.639188:0:83000:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316892.639205:0:83000:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe191da300 x1853163894039040/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/688 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316892.639216:0:83000:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00000002:00010000:0.0:1767316892.639228:0:83000:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.639240:0:83000:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767316892.639247:0:83000:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316892.639264:0:83000:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c0e 00000080:00010000:0.0:1767316892.639272:0:83000:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c0e from it ffffa99f41667bc8 00010000:00010000:0.0:1767316892.639276:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.639301:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.639326:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.639337:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316892.639345:0:83000:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.639390:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.639398:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316892.639414:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316892.639424:0:83000:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316892.639427:0:83000:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316892.639434:0:83000:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316892.639460:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1767316892.639472:0:83000:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.639480:0:83000:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316892.639499:0:83000:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316892.639517:0:83000:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 6 restore needed 0 00020000:00200000:0.0:1767316892.639522:0:83000:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316892.639524:0:83000:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316892.639527:0:83000:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316892.639536:0:83000:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316892.642293:0:83000:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 9 00010000:00010000:0.0:1767316892.642312:0:83000:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.642326:0:83000:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316892.642360:0:83000:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 154000 00000002:00100000:0.0:1767316892.642428:0:83000:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18fd4a80 x1853163894034048/t8589937426(8589937426) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316892.642441:0:83000:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316892.642446:0:83000:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191da300 x1853163894039296/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316892.642473:0:83000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894039296:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316892.642583:0:83000:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b600 going to sleep for 11 seconds 00000100:00100000:0.0:1767316892.646616:0:83000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83000:1853163894039296:192.168.202.121@tcp:35:lfs.0 00000002:00100000:0.0:1767316892.646653:0:83000:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18fd4a80 x1853163894034048/t8589937426(8589937426) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767316892.662979:0:83002:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316892.663009:0:83002:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316892.663026:0:83002:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316892.663042:0:83002:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316892.663051:0:83002:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316892.663058:0:83002:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316892.663062:0:83002:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:2.0:1767316892.663068:0:83002:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f415fbbf8 00010000:00010000:2.0:1767316892.663073:0:83002:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316892.663807:0:83002:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316892.663824:0:83002:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316892.663840:0:83002:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), file ffff9cfe08544300, open_flags 18800, mode 0 opened 0 00000080:00200000:2.0:1767316892.663846:0:83002:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open 00000002:00010000:2.0:1767316892.663863:0:83002:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0304001 00010000:00010000:2.0:1767316892.663924:0:83002:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83002 initiator: MDT0 00010000:00010000:2.0:1767316892.663933:0:83002:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83002 initiator: MDT0 00000020:00100000:2.0:1767316892.663945:0:83002:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767316892.663968:0:83002:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29109f80 x1853163894039552/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767316892.663978:0:83002:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83002 initiator: MDT0 00000100:00100000:2.0:1767316892.664001:0:83002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83002:1853163894039552:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316892.664529:0:83002:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe190a8600 going to sleep for 11 seconds 00000100:00100000:0.0:1767316892.670745:0:83002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83002:1853163894039552:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316892.670775:0:83002:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c15 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83002 initiator: MDT0 00010000:00010000:0.0:1767316892.670788:0:83002:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c15 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83002 initiator: MDT0 00010000:00010000:0.0:1767316892.670795:0:83002:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c15 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83002 initiator: MDT0 00010000:00010000:0.0:1767316892.670801:0:83002:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c15 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83002 initiator: MDT0 00010000:00010000:0.0:1767316892.670809:0:83002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c15 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83002 initiator: MDT0 00010000:00010000:0.0:1767316892.670815:0:83002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05095400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316892.670820:0:83002:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c15 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83002 initiator: MDT0 00010000:00010000:0.0:1767316892.670826:0:83002:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c15 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83002 initiator: MDT0 00010000:00010000:0.0:1767316892.670833:0:83002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c15 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83002 initiator: MDT0 00010000:00010000:0.0:1767316892.670840:0:83002:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316892.670846:0:83002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c15 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83002 initiator: MDT0 00010000:00010000:0.0:1767316892.670852:0:83002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83002 initiator: MDT0 00000002:00100000:0.0:1767316892.670888:0:83002:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=-20 req@ffff9cfe29109f80 x1853163894039552/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/608 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316892.670902:0:83002:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc -20 00000080:00200000:0.0:1767316892.671043:0:83002:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316892.671069:0:83002:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316892.671224:0:83002:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.671714:0:83002:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316892.671725:0:83002:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316892.671741:0:83002:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316892.671745:0:83002:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:1.0:1767316892.671751:0:83002:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f415fbbb0 00010000:00010000:1.0:1767316892.671755:0:83002:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.671762:0:83002:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316892.671776:0:83002:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 44 00000080:00200008:1.0:1767316892.671787:0:83002:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags 304000 00000080:00200080:1.0:1767316892.671829:0:83002:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148) cmd=c0086915 arg=f7f3d0 00000100:00100000:1.0:1767316892.671905:0:83002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83002:1853163894039680:192.168.202.121@tcp:34:lfs.0 00000100:00100000:1.0:1767316892.672010:0:83002:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316892.678537:0:83002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83002:1853163894039680:192.168.202.121@tcp:34:lfs.0 00000080:00200008:1.0:1767316892.679397:0:83002:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags 304000 00000080:00200000:1.0:1767316892.695326:0:83004:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316892.695357:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316892.695374:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.695388:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316892.695396:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316892.695402:0:83004:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316892.695406:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:1.0:1767316892.695413:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f41513b58 00010000:00010000:1.0:1767316892.695423:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.695432:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316892.695446:0:83004:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316892.695460:0:83004:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=9 00000080:00200000:1.0:1767316892.695465:0:83004:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316892.695477:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316892.695517:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83004 initiator: MDT0 00010000:00010000:1.0:1767316892.695525:0:83004:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83004 initiator: MDT0 00010000:00010000:1.0:1767316892.695534:0:83004:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83004 initiator: MDT0 00000100:00100000:1.0:1767316892.695559:0:83004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894039808:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316892.695799:0:83004:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316892.700384:0:83004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894039808:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316892.700409:0:83004:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.700427:0:83004:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.700435:0:83004:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.700466:0:83004:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.700477:0:83004:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.700490:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.700498:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.700506:0:83004:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316892.700518:0:83004:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c700 x1853163894039808/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/928 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316892.700529:0:83004:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316892.700542:0:83004:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.700551:0:83004:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316892.700558:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316892.700774:0:83004:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:1.0:1767316892.700779:0:83004:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x90:0x0](ffff9cfe187d80c8): rc = 0 00000080:00200000:1.0:1767316892.700801:0:83004:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 9 -> 9 00000080:00010000:1.0:1767316892.700812:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c1c 00000080:00010000:1.0:1767316892.700821:0:83004:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316892.700823:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c1c from it ffffa99f41513b20 00010000:00010000:1.0:1767316892.700825:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.700831:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767316892.700870:0:83004:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316892.700877:0:83004:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316892.700897:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316892.700904:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.700911:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.700928:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316892.700933:0:83004:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316892.700936:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c1c 00000080:00010000:1.0:1767316892.700940:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c1c from it ffffa99f41513cb8 00010000:00010000:1.0:1767316892.700943:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.700951:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.701177:0:83004:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316892.701322:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316892.701328:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.701334:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316892.701337:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316892.701340:0:83004:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316892.701342:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:1.0:1767316892.701345:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f41513bf8 00010000:00010000:1.0:1767316892.701347:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.701351:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316892.701357:0:83004:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316892.701362:0:83004:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:1.0:1767316892.701365:0:83004:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 46 00000080:00200008:1.0:1767316892.701372:0:83004:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 154402 00000002:00010000:1.0:1767316892.701382:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114403 00010000:00010000:1.0:1767316892.701417:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83004 initiator: MDT0 00010000:00010000:1.0:1767316892.701422:0:83004:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83004 initiator: MDT0 00000020:00100000:1.0:1767316892.701432:0:83004:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316892.701437:0:83004:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c700 x1853163894040064/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316892.701449:0:83004:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83004 initiator: MDT0 00000100:00100000:1.0:1767316892.701465:0:83004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894040064:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316892.701699:0:83004:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:2.0:1767316892.703901:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316892.703969:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939796480 00000100:00100000:3.0:1767316892.703983:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939796480 00000100:00100000:3.0:1767316892.704041:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10217 00000100:00100000:3.0:1767316892.704050:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939796480:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316892.704068:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.704155:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316892.704162:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939796480:12345-192.168.202.121@tcp:104: Request processed in 114us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316892.704169:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10217 00010000:00010000:0.0:1767316892.704232:0:63143:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316892.704240:0:63143:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.704248:0:63143:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2ca00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316892.704252:0:63143:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.704260:0:63143:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.704268:0:63143:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.704293:0:63143:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.704330:0:63143:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.704354:0:63143:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316892.704388:0:63143:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.704396:0:63143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56c1c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac867 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.704409:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316892.704411:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316892.704413:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316892.704421:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316892.704434:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894040192:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316892.707072:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894040192:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316892.707704:0:83004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894040064:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316892.707725:0:83004:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.707742:0:83004:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.707751:0:83004:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.707768:0:83004:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.707779:0:83004:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.707791:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.707799:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.707806:0:83004:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316892.707901:0:83004:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe18f3c700 x1853163894040064/t8589937437(8589937437) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316892.707928:0:83004:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3c700 x1853163894040064/t8589937437(8589937437) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316892.707947:0:83004:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.707958:0:83004:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 8 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316892.707964:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316892.708020:0:83004:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00010000:1.0:1767316892.708026:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c23 00000080:00010000:1.0:1767316892.708033:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c23 from it ffffa99f41513bf0 00010000:00010000:1.0:1767316892.708036:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.708046:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316892.708289:0:83004:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3c700 x1853163894040064/t8589937437(8589937437) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316892.708447:0:83004:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1767316892.708457:0:83004:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), xattr lov 00000080:00200008:1.0:1767316892.708489:0:83004:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316892.708495:0:83004:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316892.708512:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316892.708525:0:83004:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:1.0:1767316892.708566:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83004 initiator: MDT0 00010000:00010000:1.0:1767316892.708573:0:83004:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83004 initiator: MDT0 00010000:00010000:1.0:1767316892.708673:0:83004:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83004 initiator: MDT0 00000100:00100000:1.0:1767316892.708695:0:83004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894040320:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316892.708829:0:83004:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:2.0:1767316892.711448:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316892.711561:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939796608 00000100:00100000:3.0:1767316892.711572:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939796608 00000100:00100000:3.0:1767316892.711848:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10218 00000100:00100000:3.0:1767316892.711858:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939796608:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316892.711977:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.712063:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316892.712071:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939796608:12345-192.168.202.121@tcp:104: Request processed in 215us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316892.712135:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10218 00010000:00010000:1.0:1767316892.712169:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316892.712177:0:59093:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.712245:0:59093:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2da00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316892.712250:0:59093:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.712259:0:59093:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.712267:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.712324:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.712332:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316892.712364:0:59093:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 1/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.712379:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c23 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac875 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.712393:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316892.712395:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316892.712396:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316892.712404:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316892.712420:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894040448:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316892.717224:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894040448:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316892.717954:0:83004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894040320:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316892.717973:0:83004:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac88a expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.717985:0:83004:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac88a expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.717996:0:83004:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac88a expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.718007:0:83004:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac88a expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.718018:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac88a expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.718026:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac88a expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.718047:0:83004:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac88a expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316892.718059:0:83004:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3d180 x1853163894040320/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/928 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316892.718070:0:83004:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac88a expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316892.718119:0:83004:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac88a expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.718133:0:83004:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316892.718139:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316892.718194:0:83004:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:1.0:1767316892.718211:0:83004:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 9 -> 9 00000080:00010000:1.0:1767316892.718216:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c2a 00000080:00010000:1.0:1767316892.718221:0:83004:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316892.718224:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c2a from it ffffa99f41513cd8 00010000:00010000:1.0:1767316892.718228:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac88a expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.718236:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac88a expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200080:1.0:1767316892.718311:0:83004:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=c00c66f3 arg=1ed62a0 00000002:00010000:1.0:1767316892.718333:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 05004040000002 00010000:00010000:1.0:1767316892.718611:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56c31 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83004 initiator: MDT0 00010000:00010000:1.0:1767316892.718634:0:83004:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56c31 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83004 initiator: MDT0 00000020:00100000:1.0:1767316892.718646:0:83004:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316892.718653:0:83004:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3d180 x1853163894040704/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316892.718662:0:83004:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56c31 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x81000000000000 pid: 83004 initiator: MDT0 00000100:00100000:1.0:1767316892.718682:0:83004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894040704:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316892.718849:0:83004:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316892.721792:0:83004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894040704:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316892.721815:0:83004:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56c31 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac898 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.721826:0:83004:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56c31 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac898 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.721849:0:83004:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56c31 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac898 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.721860:0:83004:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56c31 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac898 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.721872:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56c31 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac898 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.721880:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56c31 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac898 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.721896:0:83004:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56c31 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac898 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316892.721908:0:83004:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff9cfe18f3d180 x1853163894040704/t8589937438(8589937438) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316892.721932:0:83004:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3d180 x1853163894040704/t8589937438(8589937438) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316892.721948:0:83004:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56c31 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac898 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.721962:0:83004:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 2 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316892.721968:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1767316892.721988:0:83004:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3d180 x1853163894040704/t8589937438(8589937438) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1767316892.721995:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c31 00000080:00010000:1.0:1767316892.722001:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c31 from it ffffa99f41513cc0 00010000:00010000:1.0:1767316892.722005:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56c31 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac898 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.722012:0:83004:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56c31 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac898 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316892.722061:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 7 restore needed 0 00020000:00200000:1.0:1767316892.722074:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316892.722112:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316892.722125:0:83004:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:0.0:1767316892.722432:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894040832:192.168.202.121@tcp:1:lfs.0 00000100:00100000:0.0:1767316892.724787:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894040832:192.168.202.121@tcp:1:lfs.0 00010000:00010000:1.0:1767316892.724939:0:83004:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac88a expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.724957:0:83004:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:1.0:1767316892.724974:0:83004:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.724982:0:83004:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:1.0:1767316892.725010:0:83004:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac88a expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.725018:0:83004:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.725024:0:83004:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316892.725026:0:83004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c2a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac88a expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.725038:0:83004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c0e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac821 expref: -99 pid: 83000 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767316892.725054:0:83004:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316892.725063:0:83004:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3ea00 x1853163894041088/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316892.725208:0:83004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894041088:192.168.202.121@tcp:36:lfs.0 00000100:00100000:1.0:1767316892.725267:0:83004:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316892.733745:0:83004:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937439 gen 1 00000100:00100000:1.0:1767316892.733778:0:83004:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe18f3c700 x1853163894040064/t8589937437(8589937437) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767316892.733814:0:83004:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe18f3d180 x1853163894040704/t8589937438(8589937438) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767316892.733825:0:83004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894041088:192.168.202.121@tcp:36:lfs.0 00010000:00010000:1.0:1767316892.733876:0:83004:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 31 res 8589935621/144 (0 0) 00000080:00010000:1.0:1767316892.733888:0:83004:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000002:00010000:1.0:1767316892.733898:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:1.0:1767316892.733972:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83004 initiator: MDT0 00010000:00010000:1.0:1767316892.733982:0:83004:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83004 initiator: MDT0 00010000:00010000:1.0:1767316892.733991:0:83004:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83004 initiator: MDT0 00000100:00100000:1.0:1767316892.734021:0:83004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894041216:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316892.734597:0:83004:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316892.742409:0:83004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894041216:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316892.742446:0:83004:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.742462:0:83004:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767316892.742475:0:83004:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe18f3ea00 x1853163894041216/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/688 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316892.742486:0:83004:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767316892.742566:0:83004:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.742870:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316892.742911:0:83004:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316892.742926:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316892.742944:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c38 00000080:00010000:1.0:1767316892.742953:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c38 from it ffffa99f41513c70 00010000:00010000:1.0:1767316892.743226:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.743237:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.743380:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.743393:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767316892.743402:0:83004:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.743444:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.743451:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.743481:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316892.743493:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316892.743496:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316892.743503:0:83004:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316892.743532:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1767316892.743545:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.743553:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1767316892.743561:0:83004:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.743742:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316892.743748:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316892.743751:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316892.743754:0:83004:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316892.743763:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316892.743837:0:83004:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 10 00010000:00010000:1.0:1767316892.743843:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.743851:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200080:1.0:1767316892.743870:0:83004:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=66f4 arg=1ed62a0 00000080:00200008:1.0:1767316892.743883:0:83004:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316892.743897:0:83004:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:1.0:1767316892.743911:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316892.743928:0:83004:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 30 res 8589935621/144 (0 0) 00010000:00010000:1.0:1767316892.744513:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83004 initiator: MDT0 00010000:00010000:1.0:1767316892.744521:0:83004:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83004 initiator: MDT0 00010000:00010000:1.0:1767316892.744530:0:83004:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83004 initiator: MDT0 00000100:00100000:1.0:1767316892.744553:0:83004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894041344:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316892.744930:0:83004:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316892.749029:0:83004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894041344:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316892.749056:0:83004:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.749068:0:83004:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.749100:0:83004:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.749120:0:83004:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.749132:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.749159:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.749167:0:83004:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316892.749179:0:83004:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3ea00 x1853163894041344/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/928 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316892.749191:0:83004:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316892.749205:0:83004:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.749220:0:83004:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:1.0:1767316892.749227:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316892.749300:0:83004:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 10 -> 10 00000080:00010000:1.0:1767316892.749306:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c3f 00000080:00010000:1.0:1767316892.749312:0:83004:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:1.0:1767316892.749314:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c3f from it ffffa99f41513cd8 00010000:00010000:1.0:1767316892.749317:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316892.749326:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316892.749361:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 9 restore needed 0 00020000:00200000:1.0:1767316892.749376:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316892.749379:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316892.749382:0:83004:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:1.0:1767316892.749399:0:83004:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316892.749402:0:83004:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79db0, osc lock ffff9cfe09c75db0, flags 0x400000400001002 00010000:00010000:1.0:1767316892.749448:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.749456:0:83004:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.749466:0:83004:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe18f3ea00 x1853163894041472/t0(0) o101->lustre-OST0001-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1767316892.749503:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1767316892.750475:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894041472:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316892.754388:0:2503:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.754415:0:2503:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.754429:0:2503:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.754441:0:2503:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316892.754457:0:2503:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316892.754484:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767316892.754505:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.754513:0:2503:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.754520:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.754528:0:2503:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316892.754548:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894041472:192.168.202.121@tcp:101:lfs.0 00000080:00200000:2.0:1767316892.754859:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:2.0:1767316892.754866:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b0ff8 (ffff9cfe0e436758/0) at cl_lock_release():245 00000020:00010000:2.0:1767316892.754869:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b0ff8 (ffff9cfe0e436758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.754881:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79db0 (ffff9cfe0e4c8a28/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.754885:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b0ff8 (ffff9cfe0e436758/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316892.754887:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79db0 (ffff9cfe0e436758/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316892.754900:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:3.0:1767316892.820504:0:83004:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=1 00000080:00200008:3.0:1767316892.820525:0:83004:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316892.820535:0:83004:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:3.0:1767316892.820563:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316892.820581:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.820595:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316892.820604:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316892.820613:0:83004:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:3.0:1767316892.820617:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c3f 00000080:00010000:3.0:1767316892.820623:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c3f from it ffffa99f41513cd8 00010000:00010000:3.0:1767316892.820627:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.820636:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316892.820664:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 8 restore needed 0 00020000:00200000:3.0:1767316892.820675:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767316892.820679:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767316892.820682:0:83004:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1767316892.820701:0:83004:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767316892.820705:0:83004:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aa1b0, osc lock ffff9cfe2004fa20, flags 0x400000400001002 00010000:00010000:3.0:1767316892.820720:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.820739:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316892.820752:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767316892.820756:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.820764:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316892.820774:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316892.820786:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:3.0:1767316892.820790:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:3.0:1767316892.820793:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.820796:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aa1b0 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.820800:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316892.820803:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aa1b0 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316892.820814:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767316892.820829:0:83004:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:3.0:1767316892.820834:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00020000:00200000:3.0:1767316892.820838:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767316892.820841:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1767316892.820845:0:83004:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767316892.820860:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000080:00200000:3.0:1767316892.820867:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316892.820873:0:83004:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000080:00200000:3.0:1767316892.820880:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767316892.820886:0:83004:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767316892.820891:0:83004:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:3.0:1767316892.820897:0:83004:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:3.0:1767316892.820900:0:83004:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aa1b0, osc lock ffff9cfe2004fa20, flags 0x0 00010000:00010000:3.0:1767316892.820908:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.820931:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.820940:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.820947:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.820953:0:83004:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000080:00200000:3.0:1767316892.820962:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000100:00100000:3.0:1767316892.821048:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767316892.821071:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894041600:192.168.202.121@tcp:23:lfs.0 00000100:00100000:3.0:1767316892.829037:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894041600:192.168.202.121@tcp:23:lfs.0 00000020:00010000:1.0:1767316892.829124:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:1.0:1767316892.829130:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316892.829136:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aa1b0 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1767316892.829147:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.829159:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00010000:1.0:1767316892.829173:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316892.829198:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aa1b0 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316892.829215:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1767316892.829224:0:83004:0:(file.c:5216:ll_file_seek()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:1.0:1767316892.829236:0:83004:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:1.0:1767316892.829244:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00020000:00200000:1.0:1767316892.829253:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316892.829257:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316892.829261:0:83004:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316892.829287:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000080:00200000:1.0:1767316892.829293:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316892.829299:0:83004:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000080:00200000:1.0:1767316892.829301:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316892.829306:0:83004:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316892.829310:0:83004:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:1.0:1767316892.829320:0:83004:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:1.0:1767316892.829323:0:83004:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79930, osc lock ffff9cfe09c74000, flags 0x0 00010000:00010000:1.0:1767316892.829340:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.829354:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.829366:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.829374:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316892.829392:0:83004:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316892.829402:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000100:00100000:1.0:1767316892.829454:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316892.829468:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894041728:192.168.202.121@tcp:23:lfs.0 00000100:00100000:1.0:1767316892.836498:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894041728:192.168.202.121@tcp:23:lfs.0 00000020:00010000:0.0:1767316892.836520:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:0.0:1767316892.836524:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.836530:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79930 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1767316892.836542:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.836557:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00010000:0.0:1767316892.836570:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316892.836624:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79930 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316892.836637:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767316892.836646:0:83004:0:(file.c:5216:ll_file_seek()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: SEEK_HOLE, rc = 29 00000080:00200080:0.0:1767316892.836658:0:83004:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:0.0:1767316892.836666:0:83004:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=1 00000080:00200008:0.0:1767316892.836673:0:83004:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316892.836680:0:83004:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:0.0:1767316892.836699:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316892.836716:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.836727:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316892.836733:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316892.836739:0:83004:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316892.836741:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c3f 00000080:00010000:0.0:1767316892.836746:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c3f from it ffffa99f41513cd8 00010000:00010000:0.0:1767316892.836748:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.836753:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316892.836767:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 restore needed 0 00020000:00200000:0.0:1767316892.836775:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316892.836777:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316892.836779:0:83004:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:0.0:1767316892.836796:0:83004:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316892.836799:0:83004:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9ab0, osc lock ffff9cfe201daf70, flags 0x400000400001002 00010000:00010000:0.0:1767316892.836811:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.836817:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316892.836824:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316892.836827:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.836833:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316892.836841:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316892.836850:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:0.0:1767316892.836853:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:0.0:1767316892.836856:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.836858:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9ab0 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.836862:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316892.836864:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9ab0 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316892.836871:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767316892.836892:0:83004:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 4096 00000080:00200000:0.0:1767316892.836896:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00020000:00200000:0.0:1767316892.836899:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316892.836901:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:0.0:1767316892.836904:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316892.836911:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767316892.836930:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316892.836932:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316892.836934:0:83004:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:0.0:1767316892.836941:0:83004:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316892.836942:0:83004:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9ab0, osc lock ffff9cfe201daf70, flags 0x400000400001002 00010000:00010000:0.0:1767316892.836948:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.836955:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316892.836960:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316892.836962:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.836967:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316892.836972:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316892.836974:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:0.0:1767316892.836976:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b1da8 (ffff9cfe0e4365a8/0) at cl_lock_release():245 00000020:00010000:0.0:1767316892.836977:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b1da8 (ffff9cfe0e4365a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.836978:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9ab0 (ffff9cfe0e4c8248/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.836980:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b1da8 (ffff9cfe0e4365a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316892.836982:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9ab0 (ffff9cfe0e4365a8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316892.836986:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316892.836990:0:83004:0:(file.c:2367:file_read_confine_iter()) f212b.sanity-flr: read [0, 4096] over eof, kms 29, file_size 29. 00000080:00200000:0.0:1767316892.837074:0:83004:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:0.0:1767316892.837101:0:83004:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000020:00200000:0.0:1767316892.837108:0:83004:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:0.0:1767316892.837110:0:83004:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:0.0:1767316892.837113:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00000080:00200000:0.0:1767316892.837122:0:83004:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1767316892.837127:0:83004:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:0.0:1767316892.837131:0:83004:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316892.837143:0:83004:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:0.0:1767316892.837150:0:83004:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:0.0:1767316892.837154:0:83004:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9ab0, osc lock ffff9cfe201daf70, flags 0x40000 00000080:00200000:0.0:1767316892.837159:0:83004:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000080:00200000:0.0:1767316892.837168:0:83004:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:0.0:1767316892.837174:0:83004:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:0.0:1767316892.837218:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1767316892.837220:0:83004:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:0.0:1767316892.837224:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:0.0:1767316892.837226:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.837228:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9ab0 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.837229:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316892.837231:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9ab0 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316892.837234:0:83004:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:0.0:1767316892.837237:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1767316892.837253:0:49615:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe21417780 00000008:00100000:0.0:1767316892.837291:0:49615:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe191da300 - object 0x280000400:162 offset 0<>29 00000100:00100000:0.0:1767316892.837330:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316892.837345:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894041856:192.168.202.121@tcp:3:lfs.0 00000008:00010000:0.0:1767316892.839785:0:2502:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe21417780 00000020:00200000:0.0:1767316892.839799:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1767316892.839807:0:2502:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:0.0:1767316892.839815:0:2502:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:0.0:1767316892.839843:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1767316892.839862:0:2502:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe21417780 00000100:00100000:0.0:1767316892.839888:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894041856:192.168.202.121@tcp:3:lfs.0 00000080:00200000:3.0:1767316892.840404:0:83004:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1767316892.840418:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316892.840425:0:83004:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:3.0:1767316892.840428:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316892.840443:0:83004:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:3.0:1767316892.840461:0:83004:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:3.0:1767316892.840470:0:83004:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=2 00000080:00200008:3.0:1767316892.840475:0:83004:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316892.840481:0:83004:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:3.0:1767316892.840500:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316892.840514:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.840528:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316892.840536:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316892.840543:0:83004:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:3.0:1767316892.840547:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c3f 00000080:00010000:3.0:1767316892.840553:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c3f from it ffffa99f41513cd8 00010000:00010000:3.0:1767316892.840557:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316892.840564:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316892.840587:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 restore needed 0 00020000:00200000:3.0:1767316892.840599:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767316892.840602:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1767316892.840606:0:83004:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1767316892.840625:0:83004:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1767316892.840628:0:83004:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aad30, osc lock ffff9cfe2004e260, flags 0x400000400001002 00010000:00010000:3.0:1767316892.840645:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.840674:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316892.840686:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1767316892.840689:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.840696:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767316892.840706:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316892.840715:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:3.0:1767316892.840719:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:3.0:1767316892.840722:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.840725:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aad30 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.840728:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316892.840731:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aad30 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316892.840738:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1767316892.840756:0:83004:0:(file.c:2648:do_file_write_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 4096 00000080:00200000:3.0:1767316892.840761:0:83004:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:3.0:1767316892.840768:0:83004:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:3.0:1767316892.840774:0:83004:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:3.0:1767316892.840776:0:83004:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:3.0:1767316892.840779:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00000080:00200000:3.0:1767316892.840788:0:83004:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767316892.840794:0:83004:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:3.0:1767316892.840804:0:83004:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:3.0:1767316892.840818:0:83004:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1767316892.840836:0:83004:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1767316892.840839:0:83004:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe293aad30, osc lock ffff9cfe2004e260, flags 0x40000 00000080:00200000:3.0:1767316892.840848:0:83004:0:(vvp_io.c:1312:vvp_io_write_start()) f212b.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000002:00010000:3.0:1767316892.840870:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x90:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1767316892.840923:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56c4d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 83004 initiator: MDT0 00010000:00010000:3.0:1767316892.840932:0:83004:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56c4d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 83004 initiator: MDT0 00010000:00010000:3.0:1767316892.840941:0:83004:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56c4d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 83004 initiator: MDT0 00000100:00100000:3.0:1767316892.840961:0:83004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894041984:192.168.202.121@tcp:101:lfs.0 00000100:00100000:3.0:1767316892.841055:0:83004:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0f1ae900 going to sleep for 11 seconds 00000100:00100000:3.0:1767316892.845269:0:83004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894041984:192.168.202.121@tcp:101:lfs.0 00010000:00010000:3.0:1767316892.845299:0:83004:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56c4d lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8de expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.845314:0:83004:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56c4d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac8de expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.845324:0:83004:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56c4d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8de expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316892.845335:0:83004:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=80 disposition=0, status=0 req@ffff9cfe18fd5180 x1853163894041984/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 568/1440 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316892.845344:0:83004:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56c4d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8de expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.845367:0:83004:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:3.0:1767316892.845372:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x90:0x0] suppgids 0 -1: rc 0 00000080:00010000:3.0:1767316892.845393:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c4d 00000080:00010000:3.0:1767316892.845399:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c4d from it ffffa99f415138f8 00010000:00010000:3.0:1767316892.845401:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56c4d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac8de expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316892.845408:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56c4d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8de expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316892.845440:0:83004:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=4096 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel 00000020:00200000:3.0:1767316892.845493:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767316892.845495:0:83004:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:3.0:1767316892.845509:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:3.0:1767316892.845512:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:3.0:1767316892.845515:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.845517:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe293aad30 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316892.845520:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316892.845521:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe293aad30 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316892.845527:0:83004:0:(vvp_io.c:518:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:3.0:1767316892.845532:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767316892.845547:0:60911:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe02e89f00 00000008:00100000:3.0:1767316892.845609:0:60911:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe18fd5180 - object 0x2c0000400:161 offset 0<>4096 00000100:00100000:2.0:1767316892.845727:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767316892.845746:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894042112:192.168.202.121@tcp:4:lfs.0 00000100:00100000:3.0:1767316892.852708:0:2505:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff9cfe08c17800: committing for last_committed 25769805137 gen 1 00000008:00010000:3.0:1767316892.852753:0:2505:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe02e89f00 00000020:00200000:3.0:1767316892.852759:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316892.852766:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316892.852797:0:2505:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe02e89f00 00000100:00100000:3.0:1767316892.852821:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894042112:192.168.202.121@tcp:4:lfs.0 00000080:00200000:0.0:1767316892.852983:0:83004:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767316892.853116:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316892.853122:0:83004:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:0.0:1767316892.853134:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00200000:0.0:1767316892.853137:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316892.853144:0:83004:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:0.0:1767316892.853162:0:83004:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:0.0:1767316892.853170:0:83004:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=1 00000080:00200008:0.0:1767316892.853178:0:83004:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316892.853243:0:83004:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:0.0:1767316892.853265:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316892.853283:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.853297:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316892.853305:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316892.853312:0:83004:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316892.853316:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c3f 00000080:00010000:0.0:1767316892.853323:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c3f from it ffffa99f41513cd8 00010000:00010000:0.0:1767316892.853327:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.853335:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316892.853362:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 restore needed 0 00020000:00200000:0.0:1767316892.853371:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316892.853374:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316892.853378:0:83004:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:0.0:1767316892.853395:0:83004:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316892.853398:0:83004:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9ab0, osc lock ffff9cfe201daf70, flags 0x400000400001002 00010000:00010000:0.0:1767316892.853413:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.853422:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316892.853432:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316892.853435:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.853441:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316892.853450:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316892.853455:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:0.0:1767316892.853459:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:0.0:1767316892.853462:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.853465:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9ab0 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.853469:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316892.853471:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9ab0 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316892.853479:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767316892.853497:0:83004:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 29, type: SEEK_DATA 00000080:00200000:0.0:1767316892.853502:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00020000:00200000:0.0:1767316892.853507:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316892.853510:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316892.853514:0:83004:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316892.853531:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000080:00200000:0.0:1767316892.853539:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316892.853543:0:83004:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000080:00200000:0.0:1767316892.853545:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316892.853549:0:83004:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316892.853553:0:83004:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:0.0:1767316892.853559:0:83004:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:0.0:1767316892.853561:0:83004:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9ab0, osc lock ffff9cfe201daf70, flags 0x0 00010000:00010000:0.0:1767316892.853569:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.853579:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.853587:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.853594:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.853601:0:83004:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316892.853623:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:0.0:1767316892.853642:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:0.0:1767316892.853645:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.853648:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9ab0 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1767316892.853652:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.853659:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00010000:0.0:1767316892.853737:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316892.853740:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9ab0 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316892.853747:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767316892.853754:0:83004:0:(file.c:5185:ll_file_seek()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: (null) 00000080:00200000:0.0:1767316892.853759:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 restore needed 0 00020000:00200000:0.0:1767316892.853763:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316892.853765:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316892.853767:0:83004:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:0.0:1767316892.853774:0:83004:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316892.853776:0:83004:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9ab0, osc lock ffff9cfe201daf70, flags 0x400000400001002 00010000:00010000:0.0:1767316892.853783:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.853792:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316892.853810:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316892.853813:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.853820:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316892.853828:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316892.853833:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:0.0:1767316892.853836:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:0.0:1767316892.853838:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.853841:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9ab0 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.853844:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316892.853846:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9ab0 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316892.853851:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767316892.853858:0:83004:0:(file.c:5216:ll_file_seek()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0], offset: 0, type: (null), rc = 29 00000080:00200080:0.0:1767316892.853863:0:83004:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:0.0:1767316892.868587:0:83004:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=2 00000080:00200008:0.0:1767316892.868609:0:83004:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316892.868620:0:83004:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:0.0:1767316892.868650:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316892.868681:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.868698:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316892.868720:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316892.868730:0:83004:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316892.868734:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c3f 00000080:00010000:0.0:1767316892.868742:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c3f from it ffffa99f41513cd8 00010000:00010000:0.0:1767316892.868746:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.868754:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316892.868780:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 restore needed 0 00020000:00200000:0.0:1767316892.868791:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316892.868794:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316892.868798:0:83004:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:0.0:1767316892.868819:0:83004:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316892.868823:0:83004:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9ab0, osc lock ffff9cfe201daf70, flags 0x400000400001002 00010000:00010000:0.0:1767316892.868840:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.868850:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316892.868861:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316892.868864:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.868870:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316892.868887:0:83004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767316892.868897:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:0.0:1767316892.868901:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:0.0:1767316892.868904:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.868907:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9ab0 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.868922:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316892.868925:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9ab0 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316892.868936:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767316892.868964:0:83004:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8) current size 29, valid attrs 2068, mode 0, uid -1941070030, gid -1, new size 29, atime 1767316892.000000000, mtime 1767316892.000000000, ctime 1767316892.000000000 00010000:00010000:0.0:1767316892.868987:0:83004:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.869363:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.869411:0:83004:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.869418:0:83004:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316892.869420:0:83004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56c3f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac8c2 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767316892.869440:0:83004:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316892.869454:0:83004:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191da300 x1853163894042368/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316892.869482:0:83004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894042368:192.168.202.121@tcp:36:lfs.0 00000100:00100000:0.0:1767316892.869638:0:83004:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b600 going to sleep for 11 seconds 00000100:00100000:0.0:1767316892.872850:0:83004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894042368:192.168.202.121@tcp:36:lfs.0 00000080:00200000:0.0:1767316892.872894:0:83004:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000080:00200000:0.0:1767316892.872900:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00020000:00200000:0.0:1767316892.872929:0:83004:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x11 00000080:00200000:0.0:1767316892.872944:0:83004:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1767316892.872959:0:83004:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1767316892.872965:0:83004:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9ab0, osc lock ffff9cfe201daf70, flags 0x0 00010000:00010000:0.0:1767316892.873038:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.873050:0:83004:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.873060:0:83004:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316892.873110:0:83004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894042496:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316892.873807:0:83004:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b600 going to sleep for 11 seconds 00000100:00100000:0.0:1767316892.878879:0:83004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894042496:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316892.878923:0:83004:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.878941:0:83004:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.878956:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316892.878987:0:83004:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 4/0,2 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.879010:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 5/0,2 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.879018:0:83004:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316892.879398:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894042624:192.168.202.121@tcp:10:lfs.0 00000100:00100000:0.0:1767316892.887822:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894042624:192.168.202.121@tcp:10:lfs.0 00000080:00200000:2.0:1767316892.890111:0:83004:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:2.0:1767316892.890125:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:2.0:1767316892.890130:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316892.890135:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9ab0 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767316892.890146:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316892.890159:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767316892.890175:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316892.890178:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9ab0 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316892.890199:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767316892.890211:0:83004:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8) current size 29, valid attrs 2168, mode 0, uid -1941070030, gid -1, new size 29, atime 1767316892.000000000, mtime 1767316892.000000000, ctime 1767316892.000000000, rc 0 00000080:00200080:2.0:1767316892.890230:0:83004:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200008:2.0:1767316892.890259:0:83004:0:(llite_lib.c:2314:ll_setattr_raw()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8) current size 29, valid attrs 101f0, mode a99f, uid 35988104, gid -25346, new size 18446635213879345352, atime 1767316891.000000000, mtime 1767316892.000000000, ctime 1767316892.000000000 00000020:00100000:2.0:1767316892.890324:0:83004:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767316892.890337:0:83004:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29108380 x1853163894042880/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767316892.890376:0:83004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894042880:192.168.202.121@tcp:36:lfs.0 00000100:00100000:2.0:1767316892.890513:0:83004:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe190a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1767316892.893426:0:83004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894042880:192.168.202.121@tcp:36:lfs.0 00000080:00200000:0.0:1767316892.893466:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 8 restore needed 0 00020000:00200000:0.0:1767316892.893477:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316892.893480:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316892.893487:0:83004:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316892.893499:0:83004:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1767316892.893515:0:83004:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1767316892.893519:0:83004:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9ab0, osc lock ffff9cfe201db690, flags 0x0 00010000:00010000:0.0:1767316892.893534:0:83004:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe04b80000 type 11 mode 2 res 10737419264/162 (0 18446744073709551615) 00010000:00010000:0.0:1767316892.901871:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.901891:0:83004:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.901928:0:83004:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316892.901959:0:83004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894043008:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316892.903230:0:83004:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b600 going to sleep for 11 seconds 00000100:00100000:3.0:1767316892.910012:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316892.910242:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939797376 00000100:00100000:2.0:1767316892.910254:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939797376 00000100:00100000:2.0:1767316892.910313:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10219 00000100:00100000:2.0:1767316892.910323:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:40542:x1853163939797376:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316892.910341:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316892.910417:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316892.910426:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:40542:x1853163939797376:12345-192.168.202.121@tcp:104: Request processed in 102us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316892.910433:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10219 00010000:00010000:0.0:1767316892.910819:0:63840:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316892.910826:0:63840:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.910836:0:63840:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2dc00 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316892.910842:0:63840:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316892.910860:0:63840:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767316892.910873:0:63840:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1767316892.910925:0:63840:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.910932:0:63840:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316892.910964:0:63840:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.910972:0:63840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56c46 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac8c9 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.911016:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316892.911018:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316892.911020:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316892.911029:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316892.911044:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894043136:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316892.922858:0:83004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894043008:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316892.922895:0:83004:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.922908:0:83004:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.922925:0:83004:0:(ldlm_request.c:303:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767316892.928832:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316892.929033:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939797504 00000100:00100000:3.0:1767316892.929042:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939797504 00000100:00100000:3.0:1767316892.929107:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10220 00000100:00100000:3.0:1767316892.929118:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:19746:x1853163939797504:12345-192.168.202.121@tcp:105: 00010000:00010000:3.0:1767316892.929135:0:56325:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 5/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.929147:0:56325:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 5/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.929157:0:56325:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 5/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.929167:0:56325:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.929178:0:56325:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.929188:0:56325:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316892.929210:0:56325:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9cfe1037d000) 00000100:00100000:3.0:1767316892.929263:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:19746:x1853163939797504:12345-192.168.202.121@tcp:105: Request processed in 147us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316892.929286:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10220 00010000:00010000:0.0:1767316892.930927:0:83004:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.930945:0:83004:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.930961:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316892.930974:0:83004:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.931012:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.931020:0:83004:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316892.931268:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894043264:192.168.202.121@tcp:2:lfs.0 00000100:00100000:1.0:1767316892.934575:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894043264:192.168.202.121@tcp:2:lfs.0 00000100:00100000:1.0:1767316892.934596:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894043136:192.168.202.121@tcp:103:ldlm_bl.0 00000020:00010000:0.0:1767316892.935295:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_release():245 00000020:00010000:0.0:1767316892.935302:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316892.935309:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9ab0 (ffff9cfe0e4c8128/1) at cl_lock_cancel():142 00010000:00010000:0.0:1767316892.935319:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316892.935334:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00010000:0.0:1767316892.935350:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284218 (ffff9cfe0e4c8248/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316892.935353:0:83004:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9ab0 (ffff9cfe0e4c8248/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316892.935371:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767316892.935385:0:83004:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8) current size 29, valid attrs 101f0, mode a99f, uid 35988104, gid -25346, new size 18446635213879345352, atime 1767316891.000000000, mtime 1767316892.000000000, ctime 1767316892.000000000, rc 0 00000080:00200080:0.0:1767316892.935407:0:83004:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=c00c66f3 arg=1ed62a0 00010000:00010000:0.0:1767316892.935466:0:83004:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56c31 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x863eb2f6655ac898 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316892.935482:0:83004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56c31 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x863eb2f6655ac898 expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316892.935515:0:83004:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3d180 x1853163894040704/t8589937438(8589937438) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316892.935526:0:83004:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316892.935531:0:83004:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8700 x1853163894043520/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316892.935554:0:83004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894043520:192.168.202.121@tcp:35:lfs.0 00000100:00100000:0.0:1767316892.935654:0:83004:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5b600 going to sleep for 11 seconds 00000100:00100000:3.0:1767316892.939575:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316892.939679:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939797632 00000100:00100000:2.0:1767316892.939690:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939797632 00000100:00100000:2.0:1767316892.939743:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10221 00000100:00100000:2.0:1767316892.939754:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15471:x1853163939797632:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316892.939772:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.939855:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316892.939861:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15471:x1853163939797632:12345-192.168.202.121@tcp:104: Request processed in 110us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316892.939868:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10221 00010000:00010000:0.0:1767316892.939998:0:42048:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316892.940006:0:42048:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.940014:0:42048:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316892.940019:0:42048:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.940028:0:42048:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.940035:0:42048:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316892.940059:0:42048:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:0.0:1767316892.940148:0:42048:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.940155:0:42048:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316892.940173:0:42048:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.940193:0:42048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56c38 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x863eb2f6655ac8b4 expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316892.940209:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316892.940210:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316892.940212:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316892.940222:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316892.940239:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894043648:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316892.943039:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894043648:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316892.958037:0:83004:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937443 gen 1 00000100:00100000:2.0:1767316892.958112:0:83004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894043520:192.168.202.121@tcp:35:lfs.0 00000002:00100000:2.0:1767316892.958146:0:83004:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3d180 x1853163894040704/t8589937438(8589937438) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1767316892.958179:0:83004:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 31 res 8589935621/144 (0 0) 00000080:00010000:2.0:1767316892.958190:0:83004:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000002:00010000:2.0:1767316892.958200:0:83004:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:2.0:1767316892.958242:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83004 initiator: MDT0 00010000:00010000:2.0:1767316892.958250:0:83004:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83004 initiator: MDT0 00010000:00010000:2.0:1767316892.958258:0:83004:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83004 initiator: MDT0 00000100:00100000:2.0:1767316892.958279:0:83004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894043776:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316892.958375:0:83004:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe190a8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1767316892.963245:0:83004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894043776:192.168.202.121@tcp:101:lfs.0 00010000:00010000:2.0:1767316892.963278:0:83004:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.963293:0:83004:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000002:00100000:2.0:1767316892.963307:0:83004:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff9cfe29108380 x1853163894043776/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 376/688 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316892.963318:0:83004:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000002:00010000:2.0:1767316892.963352:0:83004:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.963365:0:83004:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:2.0:1767316892.963371:0:83004:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1767316892.963389:0:83004:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c62 00000080:00010000:2.0:1767316892.963396:0:83004:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c62 from it ffffa99f41513bc8 00010000:00010000:2.0:1767316892.963400:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.963409:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.963432:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.963442:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1767316892.963450:0:83004:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.963490:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.963497:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316892.963521:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 10 restore needed 0 00020000:00200000:2.0:1767316892.963531:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316892.963534:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767316892.963540:0:83004:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316892.963566:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1767316892.963578:0:83004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.963586:0:83004:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1767316892.963593:0:83004:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](00000000bddbcbca) being reconfigured ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316892.963611:0:83004:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 10 restore needed 0 00020000:00200000:2.0:1767316892.963615:0:83004:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316892.963617:0:83004:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767316892.963619:0:83004:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316892.963628:0:83004:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:2.0:1767316892.963640:0:83004:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 29 blocks 8 [cma]time: 1767316891 1767316891 1767316891 by oinfo size 29 blocks 8 [cma]time 1767316892 1767316892 1767316891 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 1/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767316892.963677:0:83004:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1767316892 1767316892 0 by oinfo size 29 blocks 8 [cma]time 1767316892 1767316892 0 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 1/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767316892.963735:0:83004:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 11 00010000:00010000:2.0:1767316892.963748:0:83004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316892.963755:0:83004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767316892.963786:0:83004:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 154002 00000002:00100000:2.0:1767316892.963828:0:83004:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3c700 x1853163894040064/t8589937437(8589937437) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767316892.963838:0:83004:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767316892.963843:0:83004:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29108380 x1853163894044032/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767316892.963865:0:83004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894044032:192.168.202.121@tcp:35:lfs.0 00000100:00100000:2.0:1767316892.963964:0:83004:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe190a8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1767316892.967937:0:83004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83004:1853163894044032:192.168.202.121@tcp:35:lfs.0 00000002:00100000:2.0:1767316892.967975:0:83004:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3c700 x1853163894040064/t8589937437(8589937437) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316892.997906:0:83006:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316892.997950:0:83006:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316892.997968:0:83006:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.997984:0:83006:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316892.997993:0:83006:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316892.998001:0:83006:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316892.998005:0:83006:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:1.0:1767316892.998019:0:83006:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f41513bf8 00010000:00010000:1.0:1767316892.998024:0:83006:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316892.998032:0:83006:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316892.998048:0:83006:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316892.998063:0:83006:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), file ffff9cfe091b2000, open_flags 18800, mode 0 opened 0 00000080:00200000:1.0:1767316892.998070:0:83006:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=open 00000002:00010000:1.0:1767316892.998538:0:83006:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0304001 00010000:00010000:1.0:1767316892.998604:0:83006:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56c69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83006 initiator: MDT0 00010000:00010000:1.0:1767316892.998612:0:83006:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56c69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83006 initiator: MDT0 00000020:00100000:1.0:1767316892.998624:0:83006:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316892.998639:0:83006:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3ea00 x1853163894044288/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316892.998649:0:83006:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56c69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83006 initiator: MDT0 00000100:00100000:1.0:1767316892.998683:0:83006:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83006:1853163894044288:192.168.202.121@tcp:101:lfs.0 00000100:00100000:1.0:1767316892.999027:0:83006:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316893.009321:0:83006:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83006:1853163894044288:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316893.009341:0:83006:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56c69 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83006 initiator: MDT0 00010000:00010000:1.0:1767316893.009366:0:83006:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56c69 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83006 initiator: MDT0 00010000:00010000:1.0:1767316893.009371:0:83006:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56c69 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83006 initiator: MDT0 00010000:00010000:1.0:1767316893.009376:0:83006:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56c69 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83006 initiator: MDT0 00010000:00010000:1.0:1767316893.009381:0:83006:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56c69 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83006 initiator: MDT0 00010000:00010000:1.0:1767316893.009385:0:83006:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316893.009389:0:83006:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56c69 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83006 initiator: MDT0 00010000:00010000:1.0:1767316893.009393:0:83006:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56c69 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83006 initiator: MDT0 00010000:00010000:1.0:1767316893.009397:0:83006:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56c69 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83006 initiator: MDT0 00010000:00010000:1.0:1767316893.009401:0:83006:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316893.009406:0:83006:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56c69 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83006 initiator: MDT0 00010000:00010000:1.0:1767316893.009410:0:83006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56c69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83006 initiator: MDT0 00000002:00100000:1.0:1767316893.009423:0:83006:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=-20 req@ffff9cfe18f3ea00 x1853163894044288/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2168/608 e 0 to 0 dl 1767316908 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316893.009434:0:83006:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc -20 00000080:00200000:1.0:1767316893.009563:0:83006:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316893.009594:0:83006:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316893.009609:0:83006:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316893.009621:0:83006:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316893.009628:0:83006:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316893.009634:0:83006:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316893.009638:0:83006:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:1.0:1767316893.009643:0:83006:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f41513bb0 00010000:00010000:1.0:1767316893.009646:0:83006:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316893.009652:0:83006:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316893.009664:0:83006:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 44 00000080:00200008:1.0:1767316893.009674:0:83006:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags 304000 00000080:00200080:1.0:1767316893.009705:0:83006:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148) cmd=c0086915 arg=1f393d0 00000100:00100000:1.0:1767316893.009766:0:83006:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83006:1853163894044416:192.168.202.121@tcp:34:lfs.0 00000100:00100000:1.0:1767316893.009848:0:83006:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255300 going to sleep for 11 seconds 00000100:00100000:1.0:1767316893.012354:0:83006:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83006:1853163894044416:192.168.202.121@tcp:34:lfs.0 00000080:00200008:1.0:1767316893.012598:0:83006:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags 304000 00000080:00200000:3.0:1767316893.034927:0:83008:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:3.0:1767316893.035437:0:83008:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316893.035455:0:83008:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316893.035473:0:83008:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316893.035483:0:83008:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316893.035491:0:83008:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:3.0:1767316893.035495:0:83008:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:3.0:1767316893.035502:0:83008:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f41513b58 00010000:00010000:3.0:1767316893.035507:0:83008:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316893.035517:0:83008:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316893.035532:0:83008:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:3.0:1767316893.035548:0:83008:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=9 00000080:00200000:3.0:1767316893.035552:0:83008:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:3.0:1767316893.035568:0:83008:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f212b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316893.035616:0:83008:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83008 initiator: MDT0 00010000:00010000:3.0:1767316893.035625:0:83008:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83008 initiator: MDT0 00010000:00010000:3.0:1767316893.035643:0:83008:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83008 initiator: MDT0 00000100:00100000:3.0:1767316893.035748:0:83008:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83008:1853163894044544:192.168.202.121@tcp:101:lfs.0 00000100:00100000:3.0:1767316893.035894:0:83008:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0f1ae900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316893.042056:0:83008:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83008:1853163894044544:192.168.202.121@tcp:101:lfs.0 00010000:00010000:1.0:1767316893.042128:0:83008:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316893.042162:0:83008:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316893.042170:0:83008:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316893.042182:0:83008:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316893.042192:0:83008:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316893.042204:0:83008:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316893.042211:0:83008:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316893.042218:0:83008:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316893.042230:0:83008:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18fd5c00 x1853163894044544/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/928 e 0 to 0 dl 1767316909 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316893.042243:0:83008:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316893.042352:0:83008:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316893.042364:0:83008:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767316893.042371:0:83008:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316893.042432:0:83008:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:0.0:1767316893.042436:0:83008:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x90:0x0](ffff9cfe187d80c8): rc = 0 00000080:00200000:0.0:1767316893.042452:0:83008:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 11 -> 11 00000080:00010000:0.0:1767316893.042459:0:83008:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c70 00000080:00010000:0.0:1767316893.042472:0:83008:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316893.042476:0:83008:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c70 from it ffffa99f41513b20 00010000:00010000:0.0:1767316893.042479:0:83008:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316893.042488:0:83008:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316893.042525:0:83008:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316893.042532:0:83008:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:0.0:1767316893.042555:0:83008:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316893.042568:0:83008:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316893.042578:0:83008:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316893.042584:0:83008:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316893.042589:0:83008:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316893.042592:0:83008:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c70 00000080:00010000:0.0:1767316893.042596:0:83008:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c70 from it ffffa99f41513cb8 00010000:00010000:0.0:1767316893.042599:0:83008:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316893.042606:0:83008:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316893.042669:0:83008:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316893.042829:0:83008:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316893.042838:0:83008:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316893.042846:0:83008:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316893.042852:0:83008:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316893.042857:0:83008:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316893.042860:0:83008:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:0.0:1767316893.042863:0:83008:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f41513bf8 00010000:00010000:0.0:1767316893.042867:0:83008:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316893.042879:0:83008:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316893.042888:0:83008:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316893.042895:0:83008:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=265 00000080:00200000:0.0:1767316893.042900:0:83008:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 44 00000080:00200008:0.0:1767316893.042908:0:83008:0:(file.c:1001:ll_file_open()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 154400 00000002:00010000:0.0:1767316893.042935:0:83008:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240114401 00010000:00010000:0.0:1767316893.042990:0:83008:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad56c77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83008 initiator: MDT0 00010000:00010000:0.0:1767316893.042999:0:83008:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad56c77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83008 initiator: MDT0 00000020:00100000:0.0:1767316893.043011:0:83008:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316893.043019:0:83008:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191dbb80 x1853163894044800/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316893.043029:0:83008:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad56c77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83008 initiator: MDT0 00000100:00100000:0.0:1767316893.043051:0:83008:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83008:1853163894044800:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316893.043675:0:83008:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1767316893.049154:0:83008:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83008:1853163894044800:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316893.049284:0:83008:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad56c77 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac963 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316893.049297:0:83008:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad56c77 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac963 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316893.049323:0:83008:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad56c77 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac963 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316893.049334:0:83008:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad56c77 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac963 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316893.049349:0:83008:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe191dbb80 x1853163894044800/t8589937445(8589937445) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316909 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316893.049360:0:83008:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191dbb80 x1853163894044800/t8589937445(8589937445) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316909 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316893.049373:0:83008:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad56c77 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac963 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316893.049386:0:83008:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad56c77 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac963 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316893.049397:0:83008:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767316893.049404:0:83008:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316893.049459:0:83008:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x90:0x0], updating i_size 29 00000080:00200000:0.0:1767316893.049474:0:83008:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 11 -> 11 00000080:00010000:0.0:1767316893.049479:0:83008:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c77 00000080:00010000:0.0:1767316893.049486:0:83008:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c77 from it ffffa99f41513bf0 00010000:00010000:0.0:1767316893.049490:0:83008:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad56c77 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac963 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316893.049499:0:83008:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad56c77 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac963 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316893.050145:0:83008:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191dbb80 x1853163894044800/t8589937445(8589937445) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316909 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:0.0:1767316893.050352:0:83008:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=c00c66f3 arg=7ffda5ffb954 00000002:00010000:0.0:1767316893.050374:0:83008:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 01004040000001 00010000:00010000:0.0:1767316893.050435:0:83008:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 83008 initiator: MDT0 00010000:00010000:0.0:1767316893.050443:0:83008:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 83008 initiator: MDT0 00000020:00100000:0.0:1767316893.050456:0:83008:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316893.050463:0:83008:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191db100 x1853163894045056/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316893.050472:0:83008:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x81000000000000 pid: 83008 initiator: MDT0 00000100:00100000:0.0:1767316893.050495:0:83008:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83008:1853163894045056:192.168.202.121@tcp:101:lfs.0 00000100:00100000:0.0:1767316893.051334:0:83008:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe08c5bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1767316893.054617:0:83008:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83008:1853163894045056:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1767316893.054645:0:83008:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 4/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac978 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316893.054654:0:83008:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 4/1,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac978 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316893.054896:0:83008:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac978 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316893.054930:0:83008:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac978 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316893.054949:0:83008:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac978 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316893.054957:0:83008:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac978 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316893.054962:0:83008:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac978 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316893.054975:0:83008:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=600002b, status=0 req@ffff9cfe191db100 x1853163894045056/t8589937446(8589937446) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316909 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316893.054990:0:83008:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191db100 x1853163894045056/t8589937446(8589937446) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/952 e 0 to 0 dl 1767316909 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316893.055126:0:83008:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x863eb2f6655ac978 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316893.055140:0:83008:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 2 res 8589935621/144 (0 0) 00000080:00200000:0.0:1767316893.055146:0:83008:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1767316893.055165:0:83008:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191db100 x1853163894045056/t8589937446(8589937446) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316909 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767316893.055173:0:83008:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c7e 00000080:00010000:0.0:1767316893.055301:0:83008:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c7e from it ffffa99f41513cc0 00010000:00010000:0.0:1767316893.055305:0:83008:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac978 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316893.055318:0:83008:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x863eb2f6655ac978 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316893.055525:0:83008:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1767316893.055533:0:83008:0:(xattr.c:725:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), xattr lov 00000080:00200008:0.0:1767316893.055559:0:83008:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316893.055566:0:83008:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:0.0:1767316893.055585:0:83008:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316893.055594:0:83008:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316893.055605:0:83008:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316893.055611:0:83008:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316893.055616:0:83008:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316893.055620:0:83008:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c70 00000080:00010000:0.0:1767316893.055623:0:83008:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c70 from it ffffa99f41513cd8 00010000:00010000:0.0:1767316893.055626:0:83008:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316893.055633:0:83008:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000080:00200080:0.0:1767316893.055760:0:83008:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=66f4 arg=1 00000080:00200080:2.0:1767316893.102052:0:83008:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=1 00000080:00200008:2.0:1767316893.102075:0:83008:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316893.102346:0:83008:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:2.0:1767316893.102384:0:83008:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316893.102402:0:83008:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316893.102418:0:83008:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316893.102437:0:83008:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316893.102449:0:83008:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:2.0:1767316893.102453:0:83008:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c70 00000080:00010000:2.0:1767316893.102461:0:83008:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c70 from it ffffa99f41513cd8 00010000:00010000:2.0:1767316893.102465:0:83008:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316893.102473:0:83008:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767316893.102512:0:83008:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:2.0:1767316893.102523:0:83008:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 10 restore needed 0 00020000:00200000:2.0:1767316893.102536:0:83008:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316893.102539:0:83008:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767316893.102556:0:83008:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316893.102565:0:83008:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767316893.102574:0:83008:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 1 00000020:00200000:2.0:1767316893.102582:0:83008:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767316893.102584:0:83008:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767316893.102586:0:83008:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 restore needed 0 00000080:00200000:2.0:1767316893.102594:0:83008:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767316893.102602:0:83008:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767316893.102606:0:83008:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316893.102624:0:83008:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767316893.102640:0:83008:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767316893.102644:0:83008:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f330, osc lock ffff9cfe2013d560, flags 0x40000 00000080:00200000:2.0:1767316893.102654:0:83008:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000001:00010000:2.0:1767316893.102670:0:83008:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:2.0:1767316893.102675:0:83008:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316893.102683:0:83008:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fab0, osc lock ffff9cfe2013c000, flags 0x400001002 00010000:00010000:2.0:1767316893.102705:0:83008:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316893.102715:0:83008:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767316893.102728:0:83008:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316893.102737:0:83008:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316893.102741:0:83008:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316893.102748:0:83008:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316893.102757:0:83008:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316893.102765:0:83008:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 8 00000020:00010000:2.0:1767316893.102768:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:2.0:1767316893.102771:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316893.102774:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fab0 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316893.102777:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316893.102779:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fab0 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316893.102790:0:83008:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:2.0:1767316893.102796:0:83008:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:2.0:1767316893.103159:0:83008:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316893.103162:0:83008:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:2.0:1767316893.103246:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:2.0:1767316893.103251:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316893.103254:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f330 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316893.103257:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316893.103259:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f330 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316893.103266:0:83008:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:2.0:1767316893.103272:0:83008:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316893.103298:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45c480 00000008:00100000:2.0:1767316893.103351:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe29108380 - object 0x280000400:162 offset 0<>29 00000100:00100000:3.0:1767316893.103438:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894045184:192.168.202.121@tcp:3:lfs.0 00000100:00100000:2.0:1767316893.107517:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316893.107613:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939798144 00000100:00100000:3.0:1767316893.107622:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939798144 00000100:00100000:3.0:1767316893.107772:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10222 00000100:00100000:3.0:1767316893.107793:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:36248:x1853163939798144:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316893.107812:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316893.107919:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316893.107926:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:36248:x1853163939798144:12345-192.168.202.121@tcp:104: Request processed in 145us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316893.107935:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10222 00010000:00010000:0.0:1767316893.108006:0:49629:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316893.108014:0:49629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316893.108036:0:49629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037d000 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316893.108042:0:49629:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400020000 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316893.108065:0:49629:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1767316893.108077:0:49629:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1767316893.108154:0:49629:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400020020 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316893.108161:0:49629:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316893.108461:0:49629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400020020 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316893.108470:0:49629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56c5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400020020 nid: local remote: 0x863eb2f6655ac901 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316893.108492:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316893.108494:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316893.108496:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316893.108647:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894045312:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316893.115622:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894045312:192.168.202.121@tcp:103:ldlm_bl.0 00000008:00010000:3.0:1767316893.116967:0:2505:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45c480 00000020:00200000:3.0:1767316893.116981:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1767316893.117063:0:2505:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:3.0:1767316893.117072:0:2505:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:3.0:1767316893.118595:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1767316893.118978:0:2505:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45c480 00000100:00100000:3.0:1767316893.119026:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894045184:192.168.202.121@tcp:3:lfs.0 00000080:00200000:2.0:1767316893.119451:0:83008:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767316893.119466:0:83008:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316893.119472:0:83008:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:2.0:1767316893.119475:0:83008:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316893.119486:0:83008:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:2.0:1767316893.119503:0:83008:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:2.0:1767316893.119544:0:83008:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=2 00000080:00200008:2.0:1767316893.119554:0:83008:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316893.119564:0:83008:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:2.0:1767316893.119600:0:83008:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316893.119620:0:83008:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316893.119638:0:83008:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316893.119646:0:83008:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316893.119655:0:83008:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:2.0:1767316893.119819:0:83008:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c70 00000080:00010000:2.0:1767316893.119931:0:83008:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c70 from it ffffa99f41513cd8 00010000:00010000:2.0:1767316893.119936:0:83008:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316893.119946:0:83008:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767316893.119973:0:83008:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:2.0:1767316893.119981:0:83008:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 restore needed 0 00020000:00200000:2.0:1767316893.120002:0:83008:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316893.120006:0:83008:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1767316893.120018:0:83008:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316893.120027:0:83008:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:2.0:1767316893.120039:0:83008:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 2 00000020:00200000:2.0:1767316893.120048:0:83008:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:2.0:1767316893.120050:0:83008:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:2.0:1767316893.120052:0:83008:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 restore needed 0 00000080:00200000:2.0:1767316893.120062:0:83008:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767316893.120070:0:83008:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767316893.120074:0:83008:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:2.0:1767316893.120126:0:83008:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767316893.120146:0:83008:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767316893.120153:0:83008:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f330, osc lock ffff9cfe2013d560, flags 0x40000 00000080:00200000:2.0:1767316893.120165:0:83008:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000001:00010000:2.0:1767316893.120395:0:83008:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:2.0:1767316893.120404:0:83008:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316893.120406:0:83008:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fab0, osc lock ffff9cfe2013c000, flags 0x400001002 00010000:00010000:2.0:1767316893.120421:0:83008:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316893.120433:0:83008:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767316893.120457:0:83008:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316893.120466:0:83008:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316893.120470:0:83008:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 5/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316893.120478:0:83008:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316893.120489:0:83008:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767316893.120497:0:83008:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 16 00000020:00010000:2.0:1767316893.120501:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:2.0:1767316893.120504:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316893.120508:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fab0 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316893.120512:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316893.120515:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fab0 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316893.120527:0:83008:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:2.0:1767316893.120533:0:83008:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:2.0:1767316893.120582:0:83008:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1767316893.120585:0:83008:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:2.0:1767316893.120592:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:2.0:1767316893.120595:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316893.120597:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f330 (ffff9cfe0e4365a8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316893.120600:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316893.120603:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f330 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316893.120618:0:83008:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:2.0:1767316893.120623:0:83008:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1767316893.120648:0:72416:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe0e45c300 00000008:00100000:2.0:1767316893.120934:0:72416:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe29108700 - object 0x2c0000400:161 offset 0<>29 00000100:00100000:3.0:1767316893.121118:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894045440:192.168.202.121@tcp:3:lfs.0 00000100:00100000:3.0:1767316893.124443:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316893.124705:0:56325:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767316893.124728:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939798272 00000100:00100000:2.0:1767316893.124738:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939798272 00000100:00100000:2.0:1767316893.124794:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10223 00000100:00100000:2.0:1767316893.124805:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29096c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:36248:x1853163939798272:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316893.125141:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316893.125347:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316893.125355:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29096c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:36248:x1853163939798272:12345-192.168.202.121@tcp:104: Request processed in 551us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316893.125362:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10223 00010000:00010000:1.0:1767316893.127482:0:63296:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316893.127499:0:63296:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316893.127515:0:63296:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037de00 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:1.0:1767316893.127522:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316893.127550:0:63296:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1767316893.127565:0:63296:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1767316893.127627:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316893.127635:0:63296:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767316893.127756:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894045568:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767316893.127899:0:63296:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316893.127908:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56c54 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0x863eb2f6655ac8f3 expref: -99 pid: 83004 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316893.127947:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316893.127949:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316893.127951:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316893.133063:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894045568:192.168.202.121@tcp:103:ldlm_bl.0 00000008:00010000:2.0:1767316893.134705:0:2504:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe0e45c300 00000020:00200000:2.0:1767316893.134714:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767316893.134722:0:2504:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:2.0:1767316893.134730:0:2504:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:2.0:1767316893.134741:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767316893.134757:0:2504:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe0e45c300 00000100:00100000:2.0:1767316893.134779:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894045440:192.168.202.121@tcp:3:lfs.0 00000080:00200000:3.0:1767316893.134928:0:83008:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1767316893.134940:0:83008:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316893.134944:0:83008:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:3.0:1767316893.134946:0:83008:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316893.134953:0:83008:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:3.0:1767316893.134970:0:83008:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:3.0:1767316893.134982:0:83008:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=3 00000080:00200008:3.0:1767316893.134989:0:83008:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316893.134996:0:83008:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:3.0:1767316893.135023:0:83008:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316893.135039:0:83008:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316893.135049:0:83008:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316893.135055:0:83008:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316893.135061:0:83008:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:3.0:1767316893.135063:0:83008:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c70 00000080:00010000:3.0:1767316893.135068:0:83008:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c70 from it ffffa99f41513cd8 00010000:00010000:3.0:1767316893.135070:0:83008:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316893.135075:0:83008:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000080:00200008:3.0:1767316893.135116:0:83008:0:(file.c:2474:do_file_read_iter()) START file f212b.sanity-flr:[0x200000405:0x90:0x0], ppos: 0, count: 29 00000080:00200000:3.0:1767316893.135123:0:83008:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 restore needed 0 00020000:00200000:3.0:1767316893.135133:0:83008:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:3.0:1767316893.135148:0:83008:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1767316893.135160:0:83008:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316893.135166:0:83008:0:(file.c:1994:ll_file_io_generic()) f212b.sanity-flr: read ppos: 0, bytes: 29 00000080:00200000:3.0:1767316893.135525:0:83008:0:(file.c:1759:ll_io_set_mirror()) f212b.sanity-flr: desiginated mirror: 3 00000020:00200000:3.0:1767316893.135532:0:83008:0:(cl_io.c:214:cl_io_rw_init()) header@000000004351df07[0x4, 2, [0x200000405:0x90:0x0] hash] 00000020:00200000:3.0:1767316893.135534:0:83008:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 29) 2048 0 00000080:00200000:3.0:1767316893.135536:0:83008:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 restore needed 0 00000080:00200000:2.0:1767316893.135802:0:83008:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767316893.135808:0:83008:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 29) 29, 29 00020000:00200000:2.0:1767316893.135811:0:83008:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1767316893.135891:0:83008:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1767316893.135904:0:83008:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1767316893.135907:0:83008:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f330, osc lock ffff9cfe2013d560, flags 0x40000 00000080:00200000:2.0:1767316893.135923:0:83008:0:(vvp_io.c:827:vvp_io_read_start()) f212b.sanity-flr: read [0, 29) 00000001:00010000:2.0:1767316893.135941:0:83008:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:2.0:1767316893.135947:0:83008:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316893.135949:0:83008:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fab0, osc lock ffff9cfe2013c000, flags 0x400001002 00010000:00010000:2.0:1767316893.136000:0:83008:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c85 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83008 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316893.136011:0:83008:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c85 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83008 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1767316893.136311:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894045696:192.168.202.121@tcp:101:lfs.0 00000020:00200000:2.0:1767316893.136656:0:83008:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767316893.138978:0:2505:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c85 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83008 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316893.139006:0:2505:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c85 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac994 expref: -99 pid: 83008 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316893.139021:0:2505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c85 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac994 expref: -99 pid: 83008 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316893.139034:0:2505:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c85 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac994 expref: -99 pid: 83008 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767316893.139048:0:2505:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 29, setting rss=29; kms=29, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c85 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac994 expref: -99 pid: 83008 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316893.139059:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1767316893.139072:0:2505:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c85 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac994 expref: -99 pid: 83008 timeout: 0 lvb_type: 1 00000080:00200000:3.0:1767316893.139115:0:83008:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 29 i_blocks 24 00000020:00010000:3.0:1767316893.139122:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:3.0:1767316893.139126:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316893.139132:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fab0 (ffff9cfe0e436758/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316893.139136:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16910 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316893.139139:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fab0 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316893.139154:0:83008:0:(vvp_io.c:886:vvp_io_read_start()) count:29 iocb pos:0 00000080:00200000:3.0:1767316893.139161:0:83008:0:(rw26.c:439:ll_direct_IO_impl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8), size=29 (max 603979776), offset=0=0x0, pages 1 (max 147456), lockless, parallel, unaligned 00000020:00200000:3.0:1767316893.139234:0:83008:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1767316893.139238:0:83008:0:(rw26.c:570:ll_direct_IO_impl()) result 0 tot_bytes 29 count 29 file_offset 29 00000020:00010000:3.0:1767316893.139246:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_release():245 00000020:00010000:3.0:1767316893.139249:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767316893.139251:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f330 (ffff9cfe0e436758/1) at cl_lock_cancel():142 00000020:00010000:3.0:1767316893.139254:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe10284d58 (ffff9cfe0e4c8098/0) at cl_lock_fini():72 00000020:00010000:3.0:1767316893.139256:0:83008:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f330 (ffff9cfe0e4c8098/1) at cl_lock_fini():72 00000080:00200000:3.0:1767316893.139264:0:83008:0:(vvp_io.c:518:vvp_io_advance()) advancing 29 bytes 00000020:00200000:3.0:1767316893.139270:0:83008:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1767316893.139289:0:60911:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff9cfe02e89f00 00000008:00100000:3.0:1767316893.139332:0:60911:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff9cfe18fd4380 - object 0x280000400:163 offset 0<>29 00010000:00010000:2.0:1767316893.139388:0:2505:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c85 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac994 expref: -99 pid: 83008 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316893.139397:0:2505:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c85 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac994 expref: -99 pid: 83008 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316893.139404:0:2505:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac994 expref: -99 pid: 83008 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767316893.139422:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894045696:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1767316893.139445:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767316893.139455:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894045824:192.168.202.121@tcp:3:lfs.0 00000008:00010000:2.0:1767316893.142326:0:2505:0:(osc_cache.c:861:osc_extent_finish()) ### no dlm lock: extent: ffff9cfe02e89f00 00000020:00200000:2.0:1767316893.142339:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1767316893.142346:0:2505:0:(cl_io.c:1316:cl_sub_dio_end()) finishing unaligned dio read aio->cda_bytes 29 00000020:00200000:2.0:1767316893.142355:0:2505:0:(cl_io.c:1643:__ll_dio_user_copy()) count 29, offset 0, pos 0, cdp_page_count 1 00000020:00200000:2.0:1767316893.142369:0:2505:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1767316893.142383:0:2505:0:(osc_cache.c:483:__osc_extent_remove()) ### no dlm lock: extent: ffff9cfe02e89f00 00000100:00100000:2.0:1767316893.142403:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894045824:192.168.202.121@tcp:3:lfs.0 00000080:00200000:3.0:1767316893.142496:0:83008:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1767316893.142520:0:83008:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 11 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316893.142523:0:83008:0:(file.c:2142:ll_file_io_generic()) f212b.sanity-flr: 1 io complete with rc: 0, result: 29, restart: 0 00000020:00200000:3.0:1767316893.142526:0:83008:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1767316893.142531:0:83008:0:(file.c:2228:ll_file_io_generic()) iot: 1, result: 29 00000080:00200080:3.0:1767316893.142546:0:83008:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=400866b1 arg=0 00000080:00200080:2.0:1767316893.149300:0:83008:0:(file.c:4617:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) cmd=c00c66f3 arg=7ffda5ffb964 00010000:00010000:2.0:1767316893.149327:0:83008:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x863eb2f6655ac978 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316893.149377:0:83008:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 1/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x863eb2f6655ac978 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316893.149399:0:83008:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1767316893.149421:0:83008:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83008:1853163894045952:192.168.202.121@tcp:103:lfs.0 00000100:00100000:2.0:1767316893.149635:0:83008:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe190a8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316893.151708:0:83008:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83008:1853163894045952:192.168.202.121@tcp:103:lfs.0 00010000:00010000:2.0:1767316893.151741:0:83008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56c7e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x863eb2f6655ac978 expref: -99 pid: 83008 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316893.151806:0:83008:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191db100 x1853163894045056/t8589937446(8589937446) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316909 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767316893.151818:0:83008:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767316893.151823:0:83008:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29108700 x1853163894046208/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767316893.151845:0:83008:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83008:1853163894046208:192.168.202.121@tcp:35:lfs.0 00000100:00100000:2.0:1767316893.151926:0:83008:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe190a8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316893.153792:0:83008:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job lfs:9a586faf-b087-472d-9665-d3bc7d15b908:83008:1853163894046208:192.168.202.121@tcp:35:lfs.0 00000002:00100000:2.0:1767316893.153818:0:83008:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191db100 x1853163894045056/t8589937446(8589937446) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316909 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1767316893.153862:0:83008:0:(file.c:424:ll_file_release()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), flags 154000 00010000:00010000:2.0:1767316893.153887:0:83008:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad56c77 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac963 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316893.772466:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316894.789444:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316895.821175:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316895.945688:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2505:1853163894046336:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316895.946707:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894046592:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316895.946759:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894046848:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316895.947183:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1767316895.947193:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894046464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316895.947219:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894046720:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316895.950512:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2505:1853163894046336:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316895.953313:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894046592:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316895.956551:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894046464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316895.956568:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894046720:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316895.956579:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894046848:192.168.202.121@tcp:400:kworker.0 00010000:00010000:3.0:1767316896.836480:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316897.864159:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316898.890883:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1767316898.941037:0:83563:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test complete, duration 1902 sec =========== 20:21:37 (1767316897) 00010000:00010000:2.0:1767316899.909233:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1767316900.732980:0:83709:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-flr: start cleanup 20:21:39 (1767316899) === 00010000:00010000:1.0:1767316900.935229:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0:1767316900.936593:0:10311:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316900.936624:0:10311:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316900.936640:0:10311:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.936656:0:10311:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316900.936664:0:10311:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316900.936672:0:10311:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316900.936743:0:10311:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:0.0:1767316900.936786:0:10311:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f41c2bbb0 00010000:00010000:0.0:1767316900.936790:0:10311:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.936800:0:10311:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316900.936818:0:10311:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 44 00000080:00200008:0.0:1767316900.936829:0:10311:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags 304000 00000080:00200008:0.0:1767316900.936858:0:10311:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), request_mask 2047, flags 0, foreign 0 00000002:00010000:0.0:1767316900.936876:0:10311:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316900.936883:0:10311:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.936891:0:10311:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316900.937886:0:10311:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:10311:1853163894046976:192.168.202.121@tcp:37:bash.0 00000100:00100000:0.0:1767316900.938319:0:10311:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316900.964431:0:10311:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937447 gen 1 00000100:00100000:0.0:1767316900.964453:0:10311:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff9cfe191dbb80 x1853163894044800/t8589937445(8589937445) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316909 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1767316900.964466:0:10311:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job bash:9a586faf-b087-472d-9665-d3bc7d15b908:10311:1853163894046976:192.168.202.121@tcp:37:bash.0 00010000:00010000:0.0:1767316900.965365:0:10311:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.965380:0:10311:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316900.965410:0:10311:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316900.965434:0:10311:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316900.965450:0:10311:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.965461:0:10311:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316900.965468:0:10311:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316900.965474:0:10311:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316900.965477:0:10311:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:0.0:1767316900.965482:0:10311:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f41c2bcd8 00010000:00010000:0.0:1767316900.965485:0:10311:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.965491:0:10311:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316900.965854:0:10311:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148) pos/size0/4096 32bit_api 0 00000080:00200000:0.0:1767316900.965953:0:10311:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200008:0.0:1767316900.965973:0:10311:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags 304000 00000080:00200000:3.0:1767316900.974244:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:3.0:1767316900.974288:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316900.974306:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316900.974321:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316900.974328:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316900.974336:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:3.0:1767316900.974339:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:3.0:1767316900.974346:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f40d87b58 00010000:00010000:3.0:1767316900.974349:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316900.974357:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316900.974371:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:3.0:1767316900.974383:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d0a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:3.0:1767316900.974387:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d0a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:3.0:1767316900.974400:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d0a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316900.974446:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316900.974458:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316900.974468:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:3.0:1767316900.974494:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894047104:192.168.202.121@tcp:101:rm.0 00000100:00100000:3.0:1767316900.975364:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0918de40 going to sleep for 11 seconds 00000100:00100000:0.0:1767316900.985597:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894047104:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316900.985619:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.985640:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 4/1,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.985648:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 4/1,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.985658:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.985669:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.985681:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.985690:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.985696:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316900.985728:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18fd5880 x1853163894047104/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316916 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316900.985741:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.985752:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 9663677441/1 (0 0) 00000002:00010000:0.0:1767316900.985768:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000401:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316900.985813:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316900.985821:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316900.985829:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316900.985859:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894047232:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316900.985943:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316900.988286:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894047232:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316900.988306:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 4/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.988314:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.988323:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.988345:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.988355:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.988360:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.988364:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316900.988371:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191dad80 x1853163894047232/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/584 e 0 to 0 dl 1767316916 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316900.988382:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.988394:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677441/1 (0 0) 00000080:00200000:0.0:1767316900.988411:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316900.988448:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88) 00000080:00200000:0.0:1767316900.988454:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000401:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316900.988460:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff9cfe187ddb88) for remote lock 0xd9a0da65fad56c93 00000080:00010000:0.0:1767316900.988464:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56c8c 00000080:00010000:0.0:1767316900.988473:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x1:0x0](ffff9cfe187ddb88) 00000080:00010000:0.0:1767316900.988475:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c8c from it ffffa99f40d87b20 00010000:00010000:0.0:1767316900.988478:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.988492:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767316900.988587:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad56c93 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316900.988590:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.988597:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316900.988628:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d0a.sanity-flr:[0x240000401:0x1:0x0](ffff9cfe187ddb88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316900.988636:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88),name=d0a.sanity-flr 00000002:00010000:0.0:1767316900.988657:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000401:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316900.988666:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.988676:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316900.988683:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316900.988687:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x1:0x0](ffff9cfe187ddb88) 00000080:00010000:0.0:1767316900.988690:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56c93 00000080:00010000:0.0:1767316900.988694:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c93 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316900.988697:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.988704:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316900.988851:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316900.988862:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316900.988870:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.988877:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316900.988883:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316900.988887:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316900.988889:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:0.0:1767316900.988893:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316900.988896:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316900.988904:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316900.988912:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316900.988917:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0a.sanity-flr, flags=266 00000080:00200000:0.0:1767316900.988923:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88), inode mode 41ed mask 44 00000080:00200008:0.0:1767316900.988932:0:83725:0:(file.c:1001:ll_file_open()) START file d0a.sanity-flr:[0x240000401:0x1:0x0](ffff9cfe187ddb88), flags 704400 00000002:00010000:0.0:1767316900.988947:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000401:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316900.988996:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56c9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316900.989002:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56c9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316900.989022:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316900.989030:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191dad80 x1853163894047488/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316900.989039:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56c9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316900.989060:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894047488:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316900.989508:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316900.999331:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894047488:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316900.999359:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56c9a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316900.999381:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56c9a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316900.999389:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56c9a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316900.999395:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56c9a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316900.999403:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56c9a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316900.999409:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316900.999414:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56c9a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316900.999421:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56c9a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316900.999443:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56c9a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316900.999450:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316900.999457:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56c9a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316900.999463:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56c9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316900.999490:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe191dad80 x1853163894047488/t4294975905(4294975905) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316916 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316900.999850:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191dad80 x1853163894047488/t4294975905(4294975905) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316916 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316900.999866:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316900.999888:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000401:0x1:0x0], updating i_size 4096 00000002:00100000:0.0:1767316900.999910:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191dad80 x1853163894047488/t4294975905(4294975905) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316916 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316900.999981:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d0a.sanity-flr:[0x240000401:0x1:0x0](ffff9cfe187ddb88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316900.999989:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88),name=d0a.sanity-flr 00000002:00010000:0.0:1767316901.000010:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000401:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.000023:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.000036:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.000043:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316901.000058:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x1:0x0](ffff9cfe187ddb88) 00000080:00010000:0.0:1767316901.000062:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56c93 00000080:00010000:0.0:1767316901.000068:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c93 from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316901.000071:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.000577:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.000664:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767316901.000688:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000401:0x1:0x0]) in obj [0x240000401:0x1:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316901.000696:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.000705:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316901.001352:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894047616:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316901.001453:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.010586:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894047616:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316901.011288:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.011303:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316901.011882:0:83725:0:(file.c:424:ll_file_release()) START file d0a.sanity-flr:[0x240000401:0x1:0x0](ffff9cfe187ddb88), flags 704000 00000002:00100000:0.0:1767316901.011949:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191dad80 x1853163894047488/t4294975905(4294975905) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316916 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316901.011973:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316901.011979:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8380 x1853163894047872/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316901.012003:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894047872:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316901.012187:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.035245:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894047872:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316901.035783:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191dad80 x1853163894047488/t4294975905(4294975905) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316916 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316901.035897:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316901.035918:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.035934:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.035947:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.035955:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316901.035961:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316901.035964:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:1.0:1767316901.035971:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316901.035975:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.035983:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.035998:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316901.036004:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0a.sanity-flr, flags=266 00000080:00200000:1.0:1767316901.036011:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88), inode mode 41ed mask 44 00000080:00200008:1.0:1767316901.036018:0:83725:0:(file.c:1001:ll_file_open()) START file d0a.sanity-flr:[0x240000401:0x1:0x0](ffff9cfe187ddb88), flags 704400 00000002:00010000:1.0:1767316901.036033:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000401:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767316901.036130:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56ca1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.036140:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56ca1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316901.036162:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316901.036169:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f100 x1853163894048128/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316901.036177:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56ca1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.036275:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894048128:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.036656:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.047945:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894048128:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.047989:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56ca1 lrc: 4/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.048000:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56ca1 lrc: 4/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.048012:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56ca1 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.048022:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56ca1 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.048037:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe18f3f100 x1853163894048128/t4294975907(4294975907) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316901.048048:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f100 x1853163894048128/t4294975907(4294975907) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.048059:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56ca1 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.048131:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 16 res 9663677441/1 (0 0) 00000080:00200000:1.0:1767316901.048138:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316901.048157:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000401:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316901.048162:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56ca1 00000080:00010000:1.0:1767316901.048170:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ca1 from it ffffa99f40d87bd0 00010000:00010000:1.0:1767316901.048174:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56ca1 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.048183:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56ca1 lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.048222:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f100 x1853163894048128/t4294975907(4294975907) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316901.048293:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d0a.sanity-flr:[0x240000401:0x1:0x0](ffff9cfe187ddb88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316901.048301:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88),name=d0a.sanity-flr 00000002:00010000:1.0:1767316901.048324:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000401:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.048335:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.048347:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.048354:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316901.048359:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x1:0x0](ffff9cfe187ddb88) 00000080:00010000:1.0:1767316901.048362:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56c93 00000080:00010000:1.0:1767316901.048366:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c93 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316901.048562:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.048569:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.048652:0:83725:0:(llite_lib.c:2766:ll_statfs()) VFS Op:sb=lustre (ffff9cfe08c17800) d0a.sanity-flr proj=0 00000080:00000004:1.0:1767316901.048657:0:83725:0:(obd_class.h:1083:obd_statfs()) lustre-clilmv-ffff9cfe08c17800: age 1944, max_age 2151 00800000:00000004:1.0:1767316901.048665:0:83725:0:(obd_class.h:1083:obd_statfs()) lustre-MDT0000-mdc-ffff9cfe08c17800: age 1944, max_age 2151 00000100:00100000:1.0:1767316901.048707:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3df80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894048256:192.168.202.121@tcp:41:rm.0 00000100:00100000:1.0:1767316901.048793:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acf00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.060363:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2504:1853163894048384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316901.060444:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894048640:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316901.060472:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767316901.060477:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894048512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316901.062025:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3df80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894048256:192.168.202.121@tcp:41:rm.0 00800000:00000004:1.0:1767316901.062049:0:83725:0:(obd_class.h:1109:obd_statfs()) lustre-MDT0000-mdc-ffff9cfe08c17800: update ffff9cfe08274df8 cache blocks 1798796/1916558 objects 523403/524100 00000080:00000004:1.0:1767316901.062057:0:83725:0:(obd_class.h:1109:obd_statfs()) lustre-clilmv-ffff9cfe08c17800: update ffff9cfe08271c48 cache blocks 1798796/1916558 objects 523403/524100 00000080:00000004:1.0:1767316901.062062:0:83725:0:(llite_lib.c:2629:ll_statfs_internal()) MDC blocks 1798796/1916558 objects 523403/524100 00000080:00200000:1.0:1767316901.062185:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88) pos/size0/4096 32bit_api 0 00000080:00200000:1.0:1767316901.062227:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1767316901.062253:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88), inode mode 41ed mask 1 00000080:00200000:1.0:1767316901.062272:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0a.sanity-flr, dir=[0x240000401:0x1:0x0](ffff9cfe187ddb88), flags=0 00000080:00200000:1.0:1767316901.062277:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0a.sanity-flr, dir=[0x240000401:0x1:0x0](ffff9cfe187ddb88), intent=getattr 00000002:00010000:1.0:1767316901.062299:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0a.sanity-flr,[0x0:0x0:0x0]) in obj [0x240000401:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.062352:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.062362:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.062371:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.062404:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3df80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894048768:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.062471:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:3.0:1767316901.062889:0:2504:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff9cfe08c17800: committing for last_committed 25769805138 gen 1 00000100:00100000:3.0:1767316901.062904:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894048512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316901.062915:0:2504:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9cfe08c17800: committing for last_committed 17179875412 gen 1 00000100:00100000:3.0:1767316901.062929:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894048640:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316901.063964:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2504:1853163894048384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316901.067275:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3df80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894048768:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.067304:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 4/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.067327:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.067335:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.067346:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655aca04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.067357:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.067369:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655aca04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.067375:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655aca04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.067382:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655aca04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.067392:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3df80 x1853163894048768/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/720 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.067419:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 136 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.067432:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca04 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316901.067442:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677441/2 (0 0) 00000080:00200000:1.0:1767316901.067448:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000401:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316901.067481:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000401:0x2:0x0](ffff9cfe0edb4b08) 00000080:00200000:1.0:1767316901.067559:0:83725:0:(file.c:6809:ll_layout_conf()) [0x240000401:0x2:0x0]: layout version change: 4294967294 -> 1 00000080:00010000:1.0:1767316901.067566:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x2:0x0](ffff9cfe0edb4b08) for lock 0xd9a0da65fad56ca8 00000080:00010000:1.0:1767316901.067577:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x2:0x0](ffff9cfe0edb4b08) 00000080:00010000:1.0:1767316901.067580:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ca8 from it ffffa99f40d87df8 00010000:00010000:1.0:1767316901.067583:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655aca04 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316901.067590:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655aca04 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316901.067625:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88), inode mode 41ed mask 3 00000080:00200000:1.0:1767316901.067633:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0a.sanity-flr, dir=[0x240000401:0x1:0x0](ffff9cfe187ddb88) 00010000:00010000:1.0:1767316901.067665:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.067739:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655aca04 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316901.067751:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x240000401:0x2:0x0]: losing layout lock 00010000:00010000:1.0:1767316901.067787:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 1/0,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655aca04 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316901.067795:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 1/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.067800:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316901.067803:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56ca8 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655aca04 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316901.067817:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56c93 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac9c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316901.067832:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316901.067850:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3df80 x1853163894049024/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316901.067872:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3df80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894049024:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316901.067992:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.076882:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3df80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894049024:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316901.077032:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x240000401:0x2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316901.077045:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316901.077072:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x240000401:0x2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316901.077201:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000401:0x2:0x0](ffff9cfe0edb4b08) 00000080:00200000:1.0:1767316901.077283:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88), inode mode 41ed mask 1 00000080:00200000:1.0:1767316901.077300:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0a.sanity-flr-1, dir=[0x240000401:0x1:0x0](ffff9cfe187ddb88), flags=0 00000080:00200000:1.0:1767316901.077304:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0a.sanity-flr-1, dir=[0x240000401:0x1:0x0](ffff9cfe187ddb88), intent=getattr 00000002:00010000:1.0:1767316901.077329:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0a.sanity-flr-1,[0x0:0x0:0x0]) in obj [0x240000401:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.077379:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.077402:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.077412:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.077433:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894049152:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.077522:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acf00 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.081274:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894049152:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.081299:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 4/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca3c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.081321:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 4/1,0 mode: --/PR res: [0x240000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca3c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.081329:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 4/1,0 mode: --/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca3c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.081341:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655aca3c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.081351:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca3c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.081364:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655aca3c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.081371:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655aca3c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.081396:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655aca3c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.081407:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3dc00 x1853163894049152/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/2280 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.081418:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 1696 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca3c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.081432:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca3c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316901.081443:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677441/3 (0 0) 00000080:00200000:1.0:1767316901.081449:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000401:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316901.081474:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000401:0x3:0x0](ffff9cfe0edb5348) 00000080:00200000:1.0:1767316901.082995:0:83725:0:(file.c:6809:ll_layout_conf()) [0x240000401:0x3:0x0]: layout version change: 4294967294 -> 16 00000080:00010000:1.0:1767316901.083012:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x3:0x0](ffff9cfe0edb5348) for lock 0xd9a0da65fad56caf 00000080:00010000:1.0:1767316901.083024:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x3:0x0](ffff9cfe0edb5348) 00000080:00010000:1.0:1767316901.083027:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56caf from it ffffa99f40d87df8 00010000:00010000:1.0:1767316901.083032:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655aca3c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316901.083044:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655aca3c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316901.083099:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88), inode mode 41ed mask 3 00000080:00200000:1.0:1767316901.083108:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0a.sanity-flr-1, dir=[0x240000401:0x1:0x0](ffff9cfe187ddb88) 00010000:00010000:1.0:1767316901.083150:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655aca3c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316901.083179:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x240000401:0x3:0x0]: losing layout lock 00010000:00010000:1.0:1767316901.083228:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 1/0,0 mode: --/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655aca3c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316901.083235:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316901.083237:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56caf lrc: 0/0,0 mode: --/PR res: [0x240000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655aca3c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767316901.083264:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316901.083275:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3dc00 x1853163894049408/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316901.083299:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894049408:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316901.083457:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.090768:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894049408:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316901.090829:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x240000401:0x3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316901.090852:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000401:0x3:0x0]: flr state: 1, move mirror from 9 to 9, have retried: 0, mirror count: 16 00020000:00200000:1.0:1767316901.090856:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316901.090864:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[9] flags 0x10 00000080:00200000:1.0:1767316901.090895:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x240000401:0x3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316901.090904:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000401:0x3:0x0](ffff9cfe0edb5348) 00000080:00200000:0.0:1767316901.091303:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88), inode mode 41ed mask 1 00000080:00200000:0.0:1767316901.091324:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0a.sanity-flr-2, dir=[0x240000401:0x1:0x0](ffff9cfe187ddb88), flags=0 00000080:00200000:0.0:1767316901.091329:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0a.sanity-flr-2, dir=[0x240000401:0x1:0x0](ffff9cfe187ddb88), intent=getattr 00000002:00010000:0.0:1767316901.091354:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0a.sanity-flr-2,[0x0:0x0:0x0]) in obj [0x240000401:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.091408:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.091420:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.091429:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.091449:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894049536:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.091532:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.096421:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894049536:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.096451:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 4/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca74 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.096477:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca74 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.096495:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca74 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.096506:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655aca74 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.096518:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca74 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.096529:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655aca74 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.096536:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655aca74 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.096543:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655aca74 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.096555:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d8a80 x1853163894049536/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/1656 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.096566:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 1072 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca74 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.096579:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655aca74 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.096588:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677441/4 (0 0) 00000080:00200000:0.0:1767316901.096594:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000401:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316901.096730:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000401:0x4:0x0](ffff9cfe187dc2c8) 00000080:00200000:0.0:1767316901.096862:0:83725:0:(file.c:6809:ll_layout_conf()) [0x240000401:0x4:0x0]: layout version change: 4294967294 -> 10 00000080:00010000:0.0:1767316901.096869:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x4:0x0](ffff9cfe187dc2c8) for lock 0xd9a0da65fad56cb6 00000080:00010000:0.0:1767316901.096879:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x4:0x0](ffff9cfe187dc2c8) 00000080:00010000:0.0:1767316901.096883:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56cb6 from it ffffa99f40d87df8 00010000:00010000:0.0:1767316901.096886:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655aca74 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.096895:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655aca74 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316901.097150:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88), inode mode 41ed mask 3 00000080:00200000:0.0:1767316901.097160:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0a.sanity-flr-2, dir=[0x240000401:0x1:0x0](ffff9cfe187ddb88) 00010000:00010000:0.0:1767316901.097307:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655aca74 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316901.097323:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x240000401:0x4:0x0]: losing layout lock 00010000:00010000:0.0:1767316901.097359:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 1/0,0 mode: --/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655aca74 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.097366:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316901.097368:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cb6 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655aca74 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767316901.097391:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316901.097400:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8a80 x1853163894049792/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316901.097425:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894049792:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316901.097518:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.104946:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894049792:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316901.105010:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x240000401:0x4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316901.105023:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000401:0x4:0x0]: flr state: 1, move mirror from 9 to 9, have retried: 0, mirror count: 10 00020000:00200000:0.0:1767316901.105026:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316901.105032:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[9] flags 0x10 00000080:00200000:0.0:1767316901.105059:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x240000401:0x4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316901.105067:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000401:0x4:0x0](ffff9cfe187dc2c8) 00000080:00200008:0.0:1767316901.105354:0:83725:0:(file.c:424:ll_file_release()) START file d0a.sanity-flr:[0x240000401:0x1:0x0](ffff9cfe187ddb88), flags 704000 00010000:00010000:0.0:1767316901.105382:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56ca1 lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.105433:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316901.105454:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.105466:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.105475:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.105481:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316901.105488:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316901.105492:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:0.0:1767316901.105501:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316901.105504:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.105512:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.105547:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316901.105563:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d0a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=0 00000080:00200000:0.0:1767316901.105568:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d0a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316901.105585:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d0a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.106507:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.106521:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.106531:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.106562:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894049920:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.106679:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.111660:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894049920:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.111689:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.111708:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 4/1,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.111716:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 4/1,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.111728:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.111765:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.111778:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.111786:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.111794:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.111806:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191db480 x1853163894049920/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.111818:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.111829:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.111854:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 2/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.111862:0:83725:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.111869:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.111886:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.112054:0:83725:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000002:00010000:0.0:1767316901.112074:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000401:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.112148:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.112157:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.112165:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.112199:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894050048:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.112286:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00010000:00010000:3.0:1767316901.115379:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1767316901.115394:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.115408:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:3.0:1767316901.115413:0:63142:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.115422:0:63142:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.115432:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.115736:0:63142:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.115810:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 2/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.115817:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767316901.115856:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 1/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.115864:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56cbd lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acaac expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.115879:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316901.115881:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316901.115883:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316901.115904:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894050176:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316901.117473:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894050048:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.117497:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 4/1,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaba expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.117508:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaba expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.117520:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaba expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.117529:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaba expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.117559:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaba expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.117566:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaba expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.117573:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaba expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.117584:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d9880 x1853163894050048/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/584 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.117607:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaba expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.117620:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677441/1 (0 0) 00000080:00200000:0.0:1767316901.117639:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316901.117660:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000401:0x1:0x0], updating i_size 4096 00000080:00200000:0.0:1767316901.117664:0:83725:0:(namei.c:151:ll_iget()) got inode: [0x240000401:0x1:0x0](ffff9cfe187ddb88): rc = 0 00000080:00010000:0.0:1767316901.117669:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff9cfe187ddb88) for remote lock 0xd9a0da65fad56cc4 00000080:00010000:0.0:1767316901.117674:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x1:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56c8c 00000080:00010000:0.0:1767316901.117682:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x1:0x0](ffff9cfe187ddb88) 00000080:00010000:0.0:1767316901.117686:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c8c from it ffffa99f40d87e00 00010000:00010000:0.0:1767316901.117689:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.117696:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767316901.117718:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad56cc4 from it ffffa99f40d87e00 00010000:00010000:0.0:1767316901.117722:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaba expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.117728:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaba expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.117748:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316901.117767:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.117776:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.117785:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.117791:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316901.117795:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316901.117797:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56b35 00000080:00010000:0.0:1767316901.117801:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56b35 from it ffffa99f40d87d88 00010000:00010000:0.0:1767316901.117803:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.117809:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.117816:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316901.117824:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d0a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316901.117855:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.117899:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 1/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.117905:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316901.117948:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713c00/0xd9a0da65fad56c8c lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac9b7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316901.117979:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316901.117996:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894050304:192.168.202.121@tcp:103:rm.0 00010000:00010000:0.0:1767316901.118123:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acaba expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.118138:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56ca1 lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ac9e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.118170:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3f100 x1853163894048128/t4294975907(4294975907) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316917 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316901.118834:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316901.118855:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191db480 x1853163894050560/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316901.118876:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894050560:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316901.118929:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.121552:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894050176:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316901.125780:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894050304:192.168.202.121@tcp:103:rm.0 00000100:00100000:0.0:1767316901.126943:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894050560:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316901.126983:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3f100 x1853163894048128/t4294975907(4294975907) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767316901.127131:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 1/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acaba expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.127142:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56ca1 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac9e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.127148:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316901.127151:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cc4 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acaba expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.127164:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56ca1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac9e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316901.127901:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316901.127914:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191db480 x1853163894050816/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316901.127950:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894050816:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316901.128036:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.143796:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316901.144172:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939803008 00000100:00100000:3.0:1767316901.144217:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939803008 00000100:00100000:3.0:1767316901.144279:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10224 00000100:00100000:3.0:1767316901.144290:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939803008:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316901.144309:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.144392:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316901.144399:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939803008:12345-192.168.202.121@tcp:104: Request processed in 111us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316901.144406:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10224 00010000:00010000:0.0:1767316901.144656:0:63143:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316901.144664:0:63143:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.144673:0:63143:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316901.144677:0:63143:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.144685:0:63143:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.144704:0:63143:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.144806:0:63143:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.144812:0:63143:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316901.144855:0:63143:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.144861:0:63143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56b35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ac55e expref: -99 pid: 82992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.144878:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.144879:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.144881:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316901.144940:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316901.144955:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894050944:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316901.149129:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894050944:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316901.159631:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894050816:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316901.159672:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000401:0x1:0x0](ffff9cfe187ddb88) 00000080:00200000:0.0:1767316901.159746:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316901.159767:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.159821:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.159830:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.159864:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.159882:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894051072:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.159959:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.163198:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894051072:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.163224:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.163235:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.163246:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.163256:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.163268:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.163275:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.163282:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.163294:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d9c00 x1853163894051072/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.163322:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.163335:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316901.163342:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316901.163368:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316901.163374:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ccb 00000080:00010000:0.0:1767316901.163380:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316901.163383:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ccb from it ffffa99f40d87b58 00010000:00010000:0.0:1767316901.163386:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.163393:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.163417:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316901.163437:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d0d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316901.163442:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d0d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316901.163464:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d0d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.163504:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.163511:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.163521:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.163540:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894051200:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316901.163914:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.167029:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894051200:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316901.167057:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.167104:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.167112:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.167143:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.167155:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.167170:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.167177:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.167192:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316901.167208:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d9c00 x1853163894051200/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316901.167220:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.167230:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/3 (0 0) 00000080:00200000:2.0:1767316901.167236:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767316901.167269:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8) 00000080:00200000:2.0:1767316901.167278:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x3:0x0], updating i_size 4096 00000080:00010000:2.0:1767316901.167285:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x3:0x0](ffff9cfe0eda21c8) for lock 0xd9a0da65fad56cd2 00000080:00010000:2.0:1767316901.167298:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x3:0x0](ffff9cfe0eda21c8) 00000080:00010000:2.0:1767316901.167301:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56cd2 from it ffffa99f40d87b20 00010000:00010000:2.0:1767316901.167310:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.167317:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:2.0:1767316901.167359:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d0d.sanity-flr:[0x200000402:0x3:0x0](ffff9cfe0eda21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316901.167367:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8),name=d0d.sanity-flr 00000002:00010000:2.0:1767316901.167390:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x3:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.167397:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.167407:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.167413:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316901.167418:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x3:0x0](ffff9cfe0eda21c8) 00000080:00010000:2.0:1767316901.167421:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x3:0x0](ffff9cfe0eda21c8) for lock 0xd9a0da65fad56cd2 00000080:00010000:2.0:1767316901.167425:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56cd2 from it ffffa99f40d87cb8 00010000:00010000:2.0:1767316901.167427:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.167433:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.167500:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316901.167509:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.167515:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.167534:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.167540:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316901.167544:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316901.167547:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ccb 00000080:00010000:2.0:1767316901.167551:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ccb from it ffffa99f40d87bf8 00010000:00010000:2.0:1767316901.167554:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.167561:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.167570:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316901.167576:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0d.sanity-flr, flags=266 00000080:00200000:2.0:1767316901.167582:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8), inode mode 41ed mask 44 00000080:00200008:2.0:1767316901.167601:0:83725:0:(file.c:1001:ll_file_open()) START file d0d.sanity-flr:[0x200000402:0x3:0x0](ffff9cfe0eda21c8), flags 704400 00000002:00010000:2.0:1767316901.167617:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x3:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:2.0:1767316901.167670:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56cd9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.167677:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56cd9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:2.0:1767316901.167689:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767316901.167696:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29108000 x1853163894051456/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767316901.167705:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56cd9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316901.167734:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894051456:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316901.167918:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255b40 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.175383:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894051456:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316901.175413:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56cd9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.175429:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56cd9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.175437:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56cd9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.175445:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56cd9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.175453:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56cd9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.175460:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05095800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:2.0:1767316901.175464:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56cd9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.175471:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56cd9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.175479:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56cd9 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.175485:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767316901.175492:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56cd9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.175519:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56cd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:2.0:1767316901.175539:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe29108000 x1853163894051456/t8589937449(8589937449) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767316901.175553:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29108000 x1853163894051456/t8589937449(8589937449) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767316901.175567:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767316901.175602:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x3:0x0], updating i_size 4096 00000002:00100000:2.0:1767316901.175621:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29108000 x1853163894051456/t8589937449(8589937449) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1767316901.175685:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d0d.sanity-flr:[0x200000402:0x3:0x0](ffff9cfe0eda21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316901.175694:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8),name=d0d.sanity-flr 00000002:00010000:2.0:1767316901.175716:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x3:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.175730:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.175742:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.175750:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316901.175754:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x3:0x0](ffff9cfe0eda21c8) 00000080:00010000:2.0:1767316901.175758:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x3:0x0](ffff9cfe0eda21c8) for lock 0xd9a0da65fad56cd2 00000080:00010000:2.0:1767316901.175763:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56cd2 from it ffffa99f40d87cd8 00010000:00010000:2.0:1767316901.175766:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.175785:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.175815:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8) pos/size0/4096 32bit_api 0 00000002:00010000:2.0:1767316901.175828:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x3:0x0]) in obj [0x200000402:0x3:0x0], intent: readdir flags 0 00010000:00010000:2.0:1767316901.175834:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.175855:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1767316901.177255:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894051584:192.168.202.121@tcp:37:rm.0 00000100:00100000:2.0:1767316901.177353:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255b40 going to sleep for 11 seconds 00000100:00100000:3.0:1767316901.197120:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894051584:192.168.202.121@tcp:37:rm.0 00010000:00010000:3.0:1767316901.197788:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.197804:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1767316901.197868:0:83725:0:(file.c:424:ll_file_release()) START file d0d.sanity-flr:[0x200000402:0x3:0x0](ffff9cfe0eda21c8), flags 704000 00000002:00100000:3.0:1767316901.198285:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe29108000 x1853163894051456/t8589937449(8589937449) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767316917 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767316901.198300:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767316901.198306:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18fd4700 x1853163894051840/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2128 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767316901.198333:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894051840:192.168.202.121@tcp:35:rm.0 00000100:00100000:3.0:1767316901.198431:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0918da80 going to sleep for 11 seconds 00000100:00100000:3.0:1767316901.201892:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894051840:192.168.202.121@tcp:35:rm.0 00000002:00100000:3.0:1767316901.201965:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe29108000 x1853163894051456/t8589937449(8589937449) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767316901.202049:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:3.0:1767316901.202068:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316901.202530:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.202546:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316901.202556:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316901.202563:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:3.0:1767316901.202568:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ccb 00000080:00010000:3.0:1767316901.202575:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ccb from it ffffa99f40d87bf8 00010000:00010000:3.0:1767316901.202579:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.202587:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316901.202718:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:3.0:1767316901.202728:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0d.sanity-flr, flags=266 00000080:00200000:3.0:1767316901.202735:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8), inode mode 41ed mask 44 00000080:00200008:3.0:1767316901.202744:0:83725:0:(file.c:1001:ll_file_open()) START file d0d.sanity-flr:[0x200000402:0x3:0x0](ffff9cfe0eda21c8), flags 704400 00000002:00010000:3.0:1767316901.202766:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x3:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:3.0:1767316901.202824:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712e00/0xd9a0da65fad56ce0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316901.202857:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712e00/0xd9a0da65fad56ce0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:3.0:1767316901.202872:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767316901.202881:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18fd4700 x1853163894052096/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/133360 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767316901.202891:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712e00/0xd9a0da65fad56ce0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:3.0:1767316901.202912:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894052096:192.168.202.121@tcp:101:rm.0 00000100:00100000:3.0:1767316901.203446:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0918da80 going to sleep for 11 seconds 00000100:00100000:3.0:1767316901.215126:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894052096:192.168.202.121@tcp:101:rm.0 00010000:00010000:3.0:1767316901.215168:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712e00/0xd9a0da65fad56ce0 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb31 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.215431:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712e00/0xd9a0da65fad56ce0 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb31 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.215445:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712e00/0xd9a0da65fad56ce0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb31 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.215457:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712e00/0xd9a0da65fad56ce0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb31 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316901.215474:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe18fd4700 x1853163894052096/t8589937451(8589937451) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767316901.215489:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18fd4700 x1853163894052096/t8589937451(8589937451) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316901.215517:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712e00/0xd9a0da65fad56ce0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb31 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.215528:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935618/3 (0 0) 00000080:00200000:3.0:1767316901.215535:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767316901.215556:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x3:0x0], updating i_size 4096 00000080:00010000:3.0:1767316901.215562:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x3:0x0](ffff9cfe0eda21c8) for lock 0xd9a0da65fad56ce0 00000080:00010000:3.0:1767316901.215569:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ce0 from it ffffa99f40d87bd0 00010000:00010000:3.0:1767316901.215573:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712e00/0xd9a0da65fad56ce0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb31 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.215583:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712e00/0xd9a0da65fad56ce0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb31 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316901.215752:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18fd4700 x1853163894052096/t8589937451(8589937451) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1767316901.215821:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d0d.sanity-flr:[0x200000402:0x3:0x0](ffff9cfe0eda21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316901.215829:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8),name=d0d.sanity-flr 00000002:00010000:2.0:1767316901.215864:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x3:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.215875:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.215886:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.215892:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316901.215898:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x3:0x0](ffff9cfe0eda21c8) 00000080:00010000:2.0:1767316901.215907:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x3:0x0](ffff9cfe0eda21c8) for lock 0xd9a0da65fad56cd2 00000080:00010000:2.0:1767316901.215912:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56cd2 from it ffffa99f40d87cd8 00010000:00010000:2.0:1767316901.215915:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.216021:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.216055:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8) pos/size0/4096 32bit_api 0 00000080:00200000:2.0:1767316901.216112:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:2.0:1767316901.216136:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767316901.216160:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0d.sanity-flr-1, dir=[0x200000402:0x3:0x0](ffff9cfe0eda21c8), flags=0 00000080:00200000:2.0:1767316901.216164:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0d.sanity-flr-1, dir=[0x200000402:0x3:0x0](ffff9cfe0eda21c8), intent=getattr 00000002:00010000:2.0:1767316901.216719:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0d.sanity-flr-1,[0x0:0x0:0x0]) in obj [0x200000402:0x3:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.216772:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.216780:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.216790:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316901.216814:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894052224:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316901.217289:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.227044:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894052224:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.227076:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb54 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.227128:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb54 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.227137:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb54 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.227149:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb54 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.227162:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb54 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.227503:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb54 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.227515:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb54 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.227523:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb54 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.227536:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe29109880 x1853163894052224/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/928 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.227548:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb54 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.227577:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb54 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.227743:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/7 (0 0) 00000080:00200000:0.0:1767316901.227753:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000402:0x3:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316901.227796:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x7:0x0](ffff9cfe187ddb88) 00000080:00200000:0.0:1767316901.227882:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x7:0x0], updating i_size 0 00000080:00200000:0.0:1767316901.227910:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x7:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1767316901.227925:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x7:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56ce7 00000080:00010000:0.0:1767316901.227937:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x7:0x0](ffff9cfe187ddb88) 00000080:00010000:0.0:1767316901.227941:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ce7 from it ffffa99f40d87df8 00010000:00010000:0.0:1767316901.227943:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655acb54 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.227953:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655acb54 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316901.227985:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767316901.227993:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0d.sanity-flr-1, dir=[0x200000402:0x3:0x0](ffff9cfe0eda21c8) 00010000:00010000:0.0:1767316901.228027:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.228045:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712e00/0xd9a0da65fad56ce0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb31 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.228143:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655acb54 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316901.228168:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x7:0x0]: losing layout lock 00010000:00010000:0.0:1767316901.229074:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655acb54 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.229171:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.229367:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316901.229370:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094800/0xd9a0da65fad56ce7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655acb54 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.229391:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acb15 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316901.229409:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316901.229420:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8e00 x1853163894052480/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2128 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316901.229447:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894052480:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316901.233997:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4300 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.241878:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894052480:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316901.241950:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316901.241964:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x7:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316901.241967:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316901.241973:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:0.0:1767316901.242004:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316901.242012:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x7:0x0](ffff9cfe187ddb88) 00000080:00200000:0.0:1767316901.242171:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767316901.242212:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0d.sanity-flr-3, dir=[0x200000402:0x3:0x0](ffff9cfe0eda21c8), flags=0 00000080:00200000:0.0:1767316901.242217:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0d.sanity-flr-3, dir=[0x200000402:0x3:0x0](ffff9cfe0eda21c8), intent=getattr 00000002:00010000:0.0:1767316901.242243:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0d.sanity-flr-3,[0x0:0x0:0x0]) in obj [0x200000402:0x3:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.242297:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.242306:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.242316:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.242337:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894052608:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.242418:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4300 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.255549:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894052608:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.255579:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 4/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb8c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.255603:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 4/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb8c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.255610:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 4/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb8c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.255621:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb8c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.255644:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb8c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.255676:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb8c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.255683:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb8c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.255689:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acb8c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.255700:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191db800 x1853163894052608/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/2280 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.255710:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 1696 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb8c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.255723:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb8c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.255732:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/9 (0 0) 00000080:00200000:0.0:1767316901.255738:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000402:0x3:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316901.255783:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x9:0x0](ffff9cfe187ddb88) 00000080:00200000:0.0:1767316901.255952:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x9:0x0], updating i_size 0 00000080:00200000:0.0:1767316901.255997:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x9:0x0]: layout version change: 4294967294 -> 16 00000080:00010000:0.0:1767316901.256003:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x9:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56cee 00000080:00010000:0.0:1767316901.256014:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x9:0x0](ffff9cfe187ddb88) 00000080:00010000:0.0:1767316901.256017:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56cee from it ffffa99f40d87df8 00010000:00010000:0.0:1767316901.256020:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655acb8c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.256038:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655acb8c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316901.256076:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767316901.256135:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0d.sanity-flr-3, dir=[0x200000402:0x3:0x0](ffff9cfe0eda21c8) 00010000:00010000:0.0:1767316901.256706:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655acb8c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316901.256728:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x9:0x0]: losing layout lock 00010000:00010000:0.0:1767316901.256770:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 1/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655acb8c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.256777:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316901.256780:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655acb8c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767316901.256802:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316901.256810:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191db800 x1853163894052864/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316901.256832:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894052864:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316901.257472:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.276588:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894052864:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316901.276646:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316901.276659:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x9:0x0]: flr state: 1, move mirror from 5 to 5, have retried: 0, mirror count: 16 00020000:00200000:0.0:1767316901.276663:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316901.276670:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[5] flags 0x10 00000080:00200000:0.0:1767316901.276723:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316901.276731:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x9:0x0](ffff9cfe187ddb88) 00000080:00200000:0.0:1767316901.276926:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767316901.276944:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0d.sanity-flr, dir=[0x200000402:0x3:0x0](ffff9cfe0eda21c8), flags=0 00000080:00200000:0.0:1767316901.276949:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0d.sanity-flr, dir=[0x200000402:0x3:0x0](ffff9cfe0eda21c8), intent=getattr 00000002:00010000:0.0:1767316901.276977:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000402:0x3:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.277030:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.277040:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.277050:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.277071:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894052992:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.277205:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4300 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.284348:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894052992:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.284377:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acbc4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.284399:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acbc4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.284407:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acbc4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.284419:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acbc4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.284450:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acbc4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.284463:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acbc4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.284471:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acbc4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.284479:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acbc4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.284491:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d9f80 x1853163894052992/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/928 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.284503:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acbc4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.284515:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acbc4 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.284524:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/4 (0 0) 00000080:00200000:0.0:1767316901.284531:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000402:0x3:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316901.284561:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x4:0x0](ffff9cfe187ddb88) 00000080:00200000:0.0:1767316901.284632:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x4:0x0], updating i_size 0 00000080:00200000:0.0:1767316901.284657:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x4:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:0.0:1767316901.284664:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x4:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56cf5 00000080:00010000:0.0:1767316901.284674:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x4:0x0](ffff9cfe187ddb88) 00000080:00010000:0.0:1767316901.284677:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56cf5 from it ffffa99f40d87df8 00010000:00010000:0.0:1767316901.284687:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655acbc4 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.284696:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655acbc4 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316901.284727:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767316901.284736:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0d.sanity-flr, dir=[0x200000402:0x3:0x0](ffff9cfe0eda21c8) 00010000:00010000:0.0:1767316901.284770:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655acbc4 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316901.284785:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x4:0x0]: losing layout lock 00010000:00010000:0.0:1767316901.284821:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655acbc4 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.284827:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316901.284830:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56cf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655acbc4 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767316901.284871:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316901.284879:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9f80 x1853163894053248/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316901.284904:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894053248:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316901.284979:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4300 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.295004:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894053248:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316901.295061:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316901.295073:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x4:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316901.295076:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316901.295117:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:0.0:1767316901.295144:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316901.295150:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x4:0x0](ffff9cfe187ddb88) 00000080:00200008:0.0:1767316901.295289:0:83725:0:(file.c:424:ll_file_release()) START file d0d.sanity-flr:[0x200000402:0x3:0x0](ffff9cfe0eda21c8), flags 704000 00010000:00010000:0.0:1767316901.295317:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712e00/0xd9a0da65fad56ce0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acb31 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.295363:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316901.295380:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.295390:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.295400:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.295406:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316901.295412:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316901.295415:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ccb 00000080:00010000:0.0:1767316901.295422:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ccb from it ffffa99f40d87c10 00010000:00010000:0.0:1767316901.295426:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.295435:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.295449:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316901.295464:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d0d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=0 00000080:00200000:0.0:1767316901.295469:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d0d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316901.295482:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d0d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.295531:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.295538:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.295547:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.295567:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894053376:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.295770:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4300 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.298814:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894053376:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.298849:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acbfc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.298866:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 4/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acbfc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.298873:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 4/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acbfc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.298884:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acbfc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.298894:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acbfc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.298906:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acbfc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.298914:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acbfc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.298935:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acbfc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.298947:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d9180 x1853163894053376/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.298960:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acbfc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.298968:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/3 (0 0) 00000080:00200000:0.0:1767316901.298974:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316901.298994:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x3:0x0], updating i_size 4096 00000080:00200000:0.0:1767316901.298997:0:83725:0:(namei.c:151:ll_iget()) got inode: [0x200000402:0x3:0x0](ffff9cfe0eda21c8): rc = 0 00000080:00010000:0.0:1767316901.299002:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x3:0x0](ffff9cfe0eda21c8) for lock 0xd9a0da65fad56cfc 00000080:00010000:0.0:1767316901.299012:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x3:0x0](ffff9cfe0eda21c8) 00000080:00010000:0.0:1767316901.299015:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56cfc from it ffffa99f40d87e00 00010000:00010000:0.0:1767316901.299019:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acbfc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.299027:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acbfc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.299055:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316901.299072:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.299759:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.299967:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.299978:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316901.299986:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316901.299999:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ccb 00000080:00010000:2.0:1767316901.300005:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ccb from it ffffa99f40d87d88 00010000:00010000:2.0:1767316901.300008:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.300014:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.300026:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:2.0:1767316901.300034:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d0d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:2.0:1767316901.300061:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.303833:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acbfc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.303883:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712e00/0xd9a0da65fad56ce0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acb31 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316901.303957:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18fd4700 x1853163894052096/t8589937451(8589937451) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767316917 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767316901.303969:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767316901.303975:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29109880 x1853163894053632/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767316901.304000:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894053632:192.168.202.121@tcp:35:rm.0 00000100:00100000:2.0:1767316901.304207:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.313359:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894053632:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316901.313418:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18fd4700 x1853163894052096/t8589937451(8589937451) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2152/608 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767316901.313501:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 1/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acbfc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.313511:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712e00/0xd9a0da65fad56ce0 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acb31 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.313519:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.313525:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1767316901.313528:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56cfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acbfc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.313540:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712e00/0xd9a0da65fad56ce0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acb31 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.313552:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56ccb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acaf9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316901.313568:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316901.313573:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9180 x1853163894053888/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316901.313593:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894053888:192.168.202.121@tcp:36:rm.0 00000100:00100000:3.0:1767316901.321002:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4300 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.330677:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894053888:192.168.202.121@tcp:36:rm.0 00000080:00200000:2.0:1767316901.330742:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x3:0x0](ffff9cfe0eda21c8) 00000080:00200000:2.0:1767316901.330814:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316901.330835:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.330897:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.330907:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.331314:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316901.331341:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894054016:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316901.331415:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.335353:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894054016:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316901.335378:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.335388:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.335397:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.335405:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.335413:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.335436:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.335440:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316901.335448:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe29108000 x1853163894054016/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316901.335458:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.335467:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1767316901.335471:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767316901.335494:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767316901.335498:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d03 00000080:00010000:2.0:1767316901.335502:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316901.335504:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d03 from it ffffa99f40d87b58 00010000:00010000:2.0:1767316901.335506:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.335512:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.335529:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316901.335546:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d0h.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:2.0:1767316901.335550:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d0h.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:2.0:1767316901.335570:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d0h.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.335621:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.335626:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.335632:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316901.335648:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894054144:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316901.335711:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.341685:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894054144:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316901.341713:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.342333:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.342346:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.342358:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.342369:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.342384:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.342409:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.342415:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316901.342428:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe29108000 x1853163894054144/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/672 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316901.342442:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.342452:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/28 (0 0) 00000080:00200000:3.0:1767316901.342459:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767316901.342500:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff9cfe0ec7b248) 00000002:00010000:3.0:1767316901.342527:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316901.342574:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316901.342582:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316901.342738:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:3.0:1767316901.342761:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894054272:192.168.202.121@tcp:101:rm.0 00000100:00100000:3.0:1767316901.342916:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0918da80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.350550:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894054272:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.350578:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 4/1,0 mode: --/CR res: [0x200000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.350610:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.350621:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.350632:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.350643:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.350773:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.350780:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.350793:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18fd7800 x1853163894054272/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.350807:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.350818:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935616/4 (0 0) 00010000:00010000:0.0:1767316901.350826:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.350833:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316901.351306:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.351362:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.351371:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.351381:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316901.351404:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894054400:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316901.351557:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.361116:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894054400:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316901.361141:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 4/1,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361174:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361265:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361276:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361289:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361297:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361304:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316901.361316:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe29108700 x1853163894054400/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316901.361329:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361343:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677440/2 (0 0) 00010000:00010000:2.0:1767316901.361352:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361360:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.361400:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x1c:0x0], updating i_size 8192 00000080:00010000:2.0:1767316901.361410:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1c:0x0](ffff9cfe0ec7b248) for lock 0xd9a0da65fad56d0a 00000080:00010000:2.0:1767316901.361422:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1c:0x0](ffff9cfe0ec7b248) 00000080:00010000:2.0:1767316901.361425:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d0a from it ffffa99f40d87b20 00010000:00010000:2.0:1767316901.361429:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361437:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:2.0:1767316901.361464:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d0h.sanity-flr:[0x200000402:0x1c:0x0](ffff9cfe0ec7b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316901.361471:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff9cfe0ec7b248),name=d0h.sanity-flr 00000002:00010000:2.0:1767316901.361492:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1c:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.361501:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361512:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316901.361520:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.361525:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361532:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361554:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361566:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316901.361575:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.361580:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361717:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361724:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361731:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.361740:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1767316901.361744:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1c:0x0](ffff9cfe0ec7b248) 00000080:00010000:2.0:1767316901.361747:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1c:0x0](ffff9cfe0ec7b248) for lock 0xd9a0da65fad56d0a 00000080:00010000:2.0:1767316901.361751:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d0a from it ffffa99f40d87cb8 00010000:00010000:2.0:1767316901.361754:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361761:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316901.361771:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.361776:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361789:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361796:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361802:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316901.361810:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.361815:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361822:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361828:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361845:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.361900:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316901.361907:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.361913:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361920:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.361935:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316901.361939:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316901.361942:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d03 00000080:00010000:2.0:1767316901.361946:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d03 from it ffffa99f40d87bf8 00010000:00010000:2.0:1767316901.361949:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.361956:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.361963:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316901.361969:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0h.sanity-flr, flags=266 00000080:00200000:2.0:1767316901.361974:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff9cfe0ec7b248), inode mode 41ed mask 44 00000080:00200008:2.0:1767316901.361981:0:83725:0:(file.c:1001:ll_file_open()) START file d0h.sanity-flr:[0x200000402:0x1c:0x0](ffff9cfe0ec7b248), flags 704400 00000002:00010000:2.0:1767316901.361994:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1c:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:2.0:1767316901.362036:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094e00/0xd9a0da65fad56d1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.362042:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094e00/0xd9a0da65fad56d1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:2.0:1767316901.362051:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767316901.362058:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29108000 x1853163894054656/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767316901.362066:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094e00/0xd9a0da65fad56d1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316901.362107:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894054656:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316901.362926:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.368910:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894054656:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316901.368943:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094e00/0xd9a0da65fad56d1f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.368956:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094e00/0xd9a0da65fad56d1f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.368962:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094e00/0xd9a0da65fad56d1f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.368969:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094e00/0xd9a0da65fad56d1f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.368976:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094e00/0xd9a0da65fad56d1f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.368991:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05094e00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:2.0:1767316901.368995:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094e00/0xd9a0da65fad56d1f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.369003:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094e00/0xd9a0da65fad56d1f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.369009:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094e00/0xd9a0da65fad56d1f lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.369016:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767316901.369023:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094e00/0xd9a0da65fad56d1f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.369037:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094e00/0xd9a0da65fad56d1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:2.0:1767316901.369077:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe29108000 x1853163894054656/t8589937457(8589937457) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767316901.369161:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29108000 x1853163894054656/t8589937457(8589937457) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767316901.369177:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767316901.369210:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x1c:0x0], updating i_size 4096 00000002:00100000:2.0:1767316901.369227:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29108000 x1853163894054656/t8589937457(8589937457) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1767316901.369292:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d0h.sanity-flr:[0x200000402:0x1c:0x0](ffff9cfe0ec7b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316901.369299:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff9cfe0ec7b248),name=d0h.sanity-flr 00000002:00010000:2.0:1767316901.369318:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1c:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.369333:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.369345:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316901.369355:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.369361:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.369367:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.369376:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.369393:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316901.369406:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.369412:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.369419:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.369425:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.369431:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.369439:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1767316901.369445:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1c:0x0](ffff9cfe0ec7b248) 00000080:00010000:2.0:1767316901.369449:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1c:0x0](ffff9cfe0ec7b248) for lock 0xd9a0da65fad56d0a 00000080:00010000:2.0:1767316901.369453:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d0a from it ffffa99f40d87cd8 00010000:00010000:2.0:1767316901.369456:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.369464:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316901.369474:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.369479:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.369493:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.369500:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.369506:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316901.369513:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.369518:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.369524:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.369530:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.369536:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.369561:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff9cfe0ec7b248) pos/size0/8192 32bit_api 0 00010000:00010000:2.0:1767316901.369571:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316901.369593:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: readdir flags 0 00010000:00010000:2.0:1767316901.369599:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.369616:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1767316901.370314:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894054784:192.168.202.121@tcp:37:rm.0 00000100:00100000:2.0:1767316901.370419:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:3.0:1767316901.392703:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894054784:192.168.202.121@tcp:37:rm.0 00010000:00010000:3.0:1767316901.393807:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.393847:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316901.393873:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: readdir flags 0 00010000:00010000:3.0:1767316901.393890:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.393902:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1767316901.395524:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894054912:192.168.202.121@tcp:37:rm.0 00000100:00100000:3.0:1767316901.395631:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0918d780 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.408718:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894054912:192.168.202.121@tcp:37:rm.0 00010000:00010000:2.0:1767316901.409832:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.409860:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:2.0:1767316901.409937:0:83725:0:(file.c:424:ll_file_release()) START file d0h.sanity-flr:[0x200000402:0x1c:0x0](ffff9cfe0ec7b248), flags 704000 00000002:00100000:2.0:1767316901.410642:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe29108000 x1853163894054656/t8589937457(8589937457) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767316901.410656:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767316901.410662:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe2910a300 x1853163894055168/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767316901.410685:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894055168:192.168.202.121@tcp:35:rm.0 00000100:00100000:2.0:1767316901.410863:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255840 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.429053:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894055168:192.168.202.121@tcp:35:rm.0 00000002:00100000:2.0:1767316901.429243:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe29108000 x1853163894054656/t8589937457(8589937457) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767316901.429336:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316901.429369:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.429386:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.429400:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.429408:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316901.429414:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316901.429418:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d03 00000080:00010000:2.0:1767316901.429425:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d03 from it ffffa99f40d87bf8 00010000:00010000:2.0:1767316901.429429:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.429437:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.429452:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316901.429460:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0h.sanity-flr, flags=266 00000080:00200000:2.0:1767316901.429467:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff9cfe0ec7b248), inode mode 41ed mask 44 00000080:00200008:2.0:1767316901.429476:0:83725:0:(file.c:1001:ll_file_open()) START file d0h.sanity-flr:[0x200000402:0x1c:0x0](ffff9cfe0ec7b248), flags 704400 00000002:00010000:2.0:1767316901.429492:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1c:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:2.0:1767316901.429555:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56d26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.429563:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56d26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:2.0:1767316901.429574:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767316901.429581:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe2910a300 x1853163894055424/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767316901.429599:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56d26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316901.429618:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894055424:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316901.429795:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255840 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.437958:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894055424:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316901.437996:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56d26 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.438008:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56d26 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.438019:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56d26 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.438029:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56d26 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316901.438044:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe2910a300 x1853163894055424/t8589937459(8589937459) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767316901.438059:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe2910a300 x1853163894055424/t8589937459(8589937459) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316901.438074:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56d26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.438123:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935618/28 (0 0) 00000080:00200000:2.0:1767316901.438130:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767316901.439363:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x1c:0x0], updating i_size 4096 00000080:00010000:3.0:1767316901.439378:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1c:0x0](ffff9cfe0ec7b248) for lock 0xd9a0da65fad56d26 00000080:00010000:3.0:1767316901.439390:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d26 from it ffffa99f40d87bd0 00010000:00010000:3.0:1767316901.439395:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56d26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439406:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56d26 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316901.439437:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe2910a300 x1853163894055424/t8589937459(8589937459) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1767316901.439510:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d0h.sanity-flr:[0x200000402:0x1c:0x0](ffff9cfe0ec7b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316901.439518:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff9cfe0ec7b248),name=d0h.sanity-flr 00000002:00010000:3.0:1767316901.439552:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1c:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316901.439575:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439596:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316901.439606:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316901.439613:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439619:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439627:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439634:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316901.439643:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316901.439650:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439657:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439663:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439669:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316901.439685:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1767316901.439691:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1c:0x0](ffff9cfe0ec7b248) 00000080:00010000:3.0:1767316901.439694:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1c:0x0](ffff9cfe0ec7b248) for lock 0xd9a0da65fad56d0a 00000080:00010000:3.0:1767316901.439699:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d0a from it ffffa99f40d87cd8 00010000:00010000:3.0:1767316901.439701:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439707:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316901.439717:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316901.439722:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439729:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439736:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439742:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316901.439749:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316901.439752:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439759:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439771:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439777:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316901.439809:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff9cfe0ec7b248) pos/size0/8192 32bit_api 0 00010000:00010000:3.0:1767316901.439821:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316901.439853:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x4:0x0]) in obj [0x200000400:0x4:0x0], intent: readdir flags 0 00010000:00010000:3.0:1767316901.439859:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439867:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:3.0:1767316901.439880:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:3.0:1767316901.439883:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439889:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316901.439899:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x2:0x0]) in obj [0x240000400:0x2:0x0], intent: readdir flags 0 00010000:00010000:3.0:1767316901.439903:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439909:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:3.0:1767316901.439939:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:3.0:1767316901.439943:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.439949:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316901.439985:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff9cfe0ec7b248) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:3.0:1767316901.440011:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff9cfe0ec7b248), inode mode 41ed mask 1 00000080:00200000:3.0:1767316901.440026:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0h.sanity-flr, dir=[0x200000402:0x1c:0x0](ffff9cfe0ec7b248), flags=0 00000080:00200000:3.0:1767316901.440030:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0h.sanity-flr, dir=[0x200000402:0x1c:0x0](ffff9cfe0ec7b248), intent=getattr 00000002:00010000:3.0:1767316901.440043:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0h.sanity-flr,[0x0:0x0:0x0]) in obj [0x240000400:0x2:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316901.440149:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 3/1,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316901.440157:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 3/1,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316901.440167:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 3/1,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:3.0:1767316901.440190:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894055552:192.168.202.121@tcp:101:rm.0 00000100:00100000:3.0:1767316901.440276:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0918d540 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.447597:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894055552:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.447625:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 4/1,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc96 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.447647:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 4/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc96 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.447657:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 4/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc96 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.447668:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc96 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.447678:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc96 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.447690:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc96 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.447698:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc96 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.447706:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc96 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.447717:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18fd4e00 x1853163894055552/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/1032 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.447729:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 448 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc96 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.447756:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc96 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.447766:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677441/5 (0 0) 00000080:00200000:0.0:1767316901.447774:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000400:0x2:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316901.447811:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000401:0x5:0x0](ffff9cfe187ddb88) 00000080:00200000:0.0:1767316901.447892:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000401:0x5:0x0], updating i_size 158 00000080:00200000:0.0:1767316901.447919:0:83725:0:(file.c:6809:ll_layout_conf()) [0x240000401:0x5:0x0]: layout version change: 4294967294 -> 21 00000080:00010000:0.0:1767316901.447925:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x5:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56d2d 00000080:00010000:0.0:1767316901.447937:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x5:0x0](ffff9cfe187ddb88) 00000080:00010000:0.0:1767316901.447940:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d2d from it ffffa99f40d87df8 00010000:00010000:0.0:1767316901.447944:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655acc96 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.447953:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655acc96 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316901.447984:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff9cfe0ec7b248), inode mode 41ed mask 3 00000080:00200000:0.0:1767316901.447992:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0h.sanity-flr, dir=[0x200000402:0x1c:0x0](ffff9cfe0ec7b248) 00010000:00010000:0.0:1767316901.448025:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.448160:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655acc96 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316901.448171:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x240000401:0x5:0x0]: losing layout lock 00010000:00010000:0.0:1767316901.448267:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 1/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655acc96 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.448286:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.448292:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316901.448295:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27713800/0xd9a0da65fad56d2d lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655acc96 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316901.448311:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad56d18 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acc57 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316901.448331:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316901.448339:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9c00 x1853163894055808/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316901.448363:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894055808:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316901.448438:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.455440:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894055808:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316901.455501:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x240000401:0x5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316901.455513:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000401:0x5:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316901.455516:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316901.455522:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1767316901.455551:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x240000401:0x5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316901.455559:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000401:0x5:0x0](ffff9cfe187ddb88) 00000080:00200008:0.0:1767316901.455650:0:83725:0:(file.c:424:ll_file_release()) START file d0h.sanity-flr:[0x200000402:0x1c:0x0](ffff9cfe0ec7b248), flags 704000 00010000:00010000:0.0:1767316901.455675:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56d26 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.455738:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316901.455755:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.455766:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.455775:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.455782:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316901.455788:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316901.455791:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d03 00000080:00010000:0.0:1767316901.455798:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d03 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316901.455802:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.455809:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.455825:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316901.455866:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0h.sanity-flr, flags=0 00000080:00200000:0.0:1767316901.455873:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316901.455882:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.455888:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.455895:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.455911:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316901.455915:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316901.455918:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d03 00000080:00010000:0.0:1767316901.455921:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d03 from it ffffa99f40d87d88 00010000:00010000:0.0:1767316901.455924:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.455930:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.455938:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316901.455944:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d0h.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316901.455964:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.455987:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56d26 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acc73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.456032:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe2910a300 x1853163894055424/t8589937459(8589937459) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316901.456043:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316901.456047:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9880 x1853163894056064/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316901.456068:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894056064:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316901.456245:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.462713:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894056064:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316901.462749:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe2910a300 x1853163894055424/t8589937459(8589937459) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767316901.462824:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.462884:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56d26 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acc73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.462893:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.462900:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.462905:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767316901.462908:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad56d26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acc73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.462919:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095c00/0xd9a0da65fad56d0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acc3b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.462934:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad56d03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acc1f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316901.462952:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316901.462960:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3ca80 x1853163894056320/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316901.462982:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ca80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894056320:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316901.466257:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:3.0:1767316901.471786:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316901.471964:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939804928 00000100:00100000:2.0:1767316901.471975:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939804928 00000100:00100000:2.0:1767316901.472033:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10225 00000100:00100000:2.0:1767316901.472043:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939804928:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316901.472059:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.472186:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316901.472193:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939804928:12345-192.168.202.121@tcp:104: Request processed in 152us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316901.472200:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10225 00010000:00010000:1.0:1767316901.473890:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316901.473916:0:59093:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.473929:0:59093:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe27712200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316901.473934:0:59093:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.473943:0:59093:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.473953:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.474048:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.474056:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316901.474136:0:59093:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 1/0,0 mode: --/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.474144:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712200/0xd9a0da65fad56d11 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acc49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.474161:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316901.474163:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316901.474165:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316901.474175:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316901.474193:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894056448:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316901.480438:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894056448:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316901.486539:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ca80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894056320:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316901.486585:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x1c:0x0](ffff9cfe0ec7b248) 00000080:00200000:1.0:1767316901.486666:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316901.486687:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.486741:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.486751:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.486760:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.486779:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894056576:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.486908:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.489602:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894056576:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.489627:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.489638:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.489649:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.489659:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.489670:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.489693:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.489700:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.489710:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3d500 x1853163894056576/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.489724:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.489735:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316901.489742:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316901.489767:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316901.489773:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d34 00000080:00010000:1.0:1767316901.489779:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316901.489781:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d34 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316901.489784:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.489792:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.489822:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316901.489858:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d204a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316901.489863:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d204a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316901.489886:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d204a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.489932:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.489939:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.489949:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.489968:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894056704:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.490041:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.493188:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894056704:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.493455:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.493480:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 4/1,0 mode: --/PR res: [0x200000405:0x67:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.493488:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 4/1,0 mode: --/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.493499:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.493509:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.493522:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.493529:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.493550:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.493563:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3d500 x1853163894056704/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/672 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.493580:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.493589:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/103 (0 0) 00000080:00200000:1.0:1767316901.493595:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316901.493631:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x67:0x0](ffff9cfe0edb4b08) 00000002:00010000:1.0:1767316901.493658:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x7:0x0]) in obj [0x200000bd0:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.493705:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.493712:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.493719:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.493736:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894056832:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.493806:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.502393:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894056832:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.502417:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.502429:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.502456:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.502467:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.502479:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.502486:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.502492:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.502504:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3fb80 x1853163894056832/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.502517:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.502535:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589937616/7 (0 0) 00010000:00010000:1.0:1767316901.502544:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.502551:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.502600:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x7:0x0]) in obj [0x240000406:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.502657:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.502664:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.502672:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.502692:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894056960:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.502769:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.508156:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894056960:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.508184:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 4/1,0 mode: --/CR res: [0x240000406:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508197:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 4/1,0 mode: --/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508210:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508221:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508231:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508236:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508240:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.508261:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3fb80 x1853163894056960/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.508273:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508283:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677446/7 (0 0) 00010000:00010000:1.0:1767316901.508289:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508294:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.508329:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x67:0x0], updating i_size 8192 00000080:00010000:1.0:1767316901.508339:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x67:0x0](ffff9cfe0edb4b08) for lock 0xd9a0da65fad56d3b 00000080:00010000:1.0:1767316901.508349:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x67:0x0](ffff9cfe0edb4b08) 00000080:00010000:1.0:1767316901.508351:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d3b from it ffffa99f40d87b20 00010000:00010000:1.0:1767316901.508354:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508359:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316901.508386:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d204a.sanity-flr:[0x200000405:0x67:0x0](ffff9cfe0edb4b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316901.508392:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x67:0x0](ffff9cfe0edb4b08),name=d204a.sanity-flr 00000002:00010000:1.0:1767316901.508412:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x67:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.508420:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508436:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.508446:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x7:0x0]) in obj [0x200000bd0:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.508453:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508461:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508468:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508474:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.508483:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x7:0x0]) in obj [0x240000406:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.508487:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508493:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508500:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508508:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.508527:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316901.508533:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x67:0x0](ffff9cfe0edb4b08) 00000080:00010000:1.0:1767316901.508536:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x67:0x0](ffff9cfe0edb4b08) for lock 0xd9a0da65fad56d3b 00000080:00010000:1.0:1767316901.508540:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d3b from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316901.508543:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508549:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.508559:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x7:0x0]) in obj [0x200000bd0:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.508565:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508573:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508581:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.508869:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316901.509999:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x7:0x0]) in obj [0x240000406:0x7:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.510018:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.510032:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.510042:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.510049:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.510148:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316901.510164:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.510172:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.510196:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.510203:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316901.510209:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316901.510213:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d34 00000080:00010000:2.0:1767316901.510217:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d34 from it ffffa99f40d87bf8 00010000:00010000:2.0:1767316901.510220:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.510227:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.510236:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316901.510242:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204a.sanity-flr, flags=266 00000080:00200000:2.0:1767316901.510250:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x67:0x0](ffff9cfe0edb4b08), inode mode 41ed mask 44 00000080:00200008:2.0:1767316901.510259:0:83725:0:(file.c:1001:ll_file_open()) START file d204a.sanity-flr:[0x200000405:0x67:0x0](ffff9cfe0edb4b08), flags 704400 00000002:00010000:2.0:1767316901.510274:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x67:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:2.0:1767316901.510327:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.510334:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:2.0:1767316901.510346:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767316901.510358:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29108000 x1853163894057216/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767316901.510367:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316901.510410:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894057216:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316901.511937:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:3.0:1767316901.519362:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894057216:192.168.202.121@tcp:101:rm.0 00010000:00010000:3.0:1767316901.519388:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d50 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316901.519421:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d50 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316901.519429:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d50 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316901.519435:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d50 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316901.519443:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d50 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316901.519449:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05095800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:3.0:1767316901.519454:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d50 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316901.519461:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d50 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316901.519469:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d50 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316901.519475:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1767316901.519481:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d50 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316901.519488:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:3.0:1767316901.519509:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe29108000 x1853163894057216/t8589937462(8589937462) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767316901.519522:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29108000 x1853163894057216/t8589937462(8589937462) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767316901.519549:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767316901.519581:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x67:0x0], updating i_size 4096 00000002:00100000:3.0:1767316901.519599:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe29108000 x1853163894057216/t8589937462(8589937462) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1767316901.520410:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d204a.sanity-flr:[0x200000405:0x67:0x0](ffff9cfe0edb4b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316901.520422:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x67:0x0](ffff9cfe0edb4b08),name=d204a.sanity-flr 00000002:00010000:3.0:1767316901.520447:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x67:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316901.520463:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.520476:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316901.520486:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x7:0x0]) in obj [0x200000bd0:0x7:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316901.520491:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.520499:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.520508:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.520516:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316901.520531:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x7:0x0]) in obj [0x240000406:0x7:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316901.520538:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.520559:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.520567:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.520574:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316901.520584:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1767316901.520589:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x67:0x0](ffff9cfe0edb4b08) 00000080:00010000:3.0:1767316901.520604:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x67:0x0](ffff9cfe0edb4b08) for lock 0xd9a0da65fad56d3b 00000080:00010000:3.0:1767316901.520610:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d3b from it ffffa99f40d87cd8 00010000:00010000:3.0:1767316901.520613:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.520620:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316901.520632:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x7:0x0]) in obj [0x200000bd0:0x7:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316901.520638:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.520645:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.520652:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.520679:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316901.520687:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x7:0x0]) in obj [0x240000406:0x7:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316901.520692:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.520699:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.520707:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.520713:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316901.520741:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x67:0x0](ffff9cfe0edb4b08) pos/size0/8192 32bit_api 0 00010000:00010000:3.0:1767316901.520751:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316901.520771:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x7:0x0]) in obj [0x200000bd0:0x7:0x0], intent: readdir flags 0 00010000:00010000:3.0:1767316901.520777:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.520784:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1767316901.521460:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894057344:192.168.202.121@tcp:37:rm.0 00000100:00100000:3.0:1767316901.521574:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0918d180 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.536646:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894057344:192.168.202.121@tcp:37:rm.0 00010000:00010000:2.0:1767316901.538482:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.538503:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316901.538529:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x7:0x0]) in obj [0x240000406:0x7:0x0], intent: readdir flags 0 00010000:00010000:2.0:1767316901.538543:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.538899:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1767316901.540343:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894057472:192.168.202.121@tcp:37:rm.0 00000100:00100000:2.0:1767316901.540530:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.550463:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894057472:192.168.202.121@tcp:37:rm.0 00010000:00010000:2.0:1767316901.552156:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.552175:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.552237:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x67:0x0](ffff9cfe0edb4b08) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:2.0:1767316901.552272:0:83725:0:(file.c:424:ll_file_release()) START file d204a.sanity-flr:[0x200000405:0x67:0x0](ffff9cfe0edb4b08), flags 704000 00000002:00100000:2.0:1767316901.552346:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe29108000 x1853163894057216/t8589937462(8589937462) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767316901.552359:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767316901.552365:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe2910b100 x1853163894057728/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767316901.552389:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894057728:192.168.202.121@tcp:35:rm.0 00000100:00100000:2.0:1767316901.552479:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.557785:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894057728:192.168.202.121@tcp:35:rm.0 00000002:00100000:2.0:1767316901.557822:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe29108000 x1853163894057216/t8589937462(8589937462) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767316901.557903:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316901.557935:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.557960:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.557974:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.557983:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316901.557989:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316901.557992:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d34 00000080:00010000:2.0:1767316901.557998:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d34 from it ffffa99f40d87c10 00010000:00010000:2.0:1767316901.558002:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.558027:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.558042:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316901.558052:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204a.sanity-flr, flags=0 00000080:00200000:2.0:1767316901.558058:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316901.558065:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.558072:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.558129:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.558137:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316901.558142:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316901.558145:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d34 00000080:00010000:2.0:1767316901.558149:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d34 from it ffffa99f40d87d88 00010000:00010000:2.0:1767316901.558152:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.558159:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.558166:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:2.0:1767316901.558172:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d204a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:2.0:1767316901.558193:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.558230:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.558265:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 1/0,0 mode: --/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.558272:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.558277:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767316901.558280:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56d3b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x67:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acd06 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.558293:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56d34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655accea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767316901.558308:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767316901.558315:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe2910b100 x1853163894057984/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767316901.558336:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894057984:192.168.202.121@tcp:36:rm.0 00000100:00100000:2.0:1767316901.558409:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:3.0:1767316901.561317:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316901.562169:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939805952 00000100:00100000:2.0:1767316901.562182:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939805952 00000100:00100000:2.0:1767316901.562283:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10226 00000100:00100000:2.0:1767316901.562293:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939805952:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316901.562309:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.562395:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316901.562401:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939805952:12345-192.168.202.121@tcp:104: Request processed in 111us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316901.562406:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10226 00010000:00010000:0.0:1767316901.562449:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316901.562456:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.562471:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316901.562475:0:42049:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.562483:0:42049:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.562491:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.562608:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.562615:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316901.562643:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.562654:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56d42 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acd14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.562670:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.562672:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.562673:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316901.562684:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894058112:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316901.566539:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894058112:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316901.569374:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316901.569434:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939806208 00000100:00100000:2.0:1767316901.569445:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939806208 00000100:00100000:2.0:1767316901.569506:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10227 00000100:00100000:2.0:1767316901.569516:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939806208:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316901.569532:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.569605:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316901.569612:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939806208:12345-192.168.202.121@tcp:104: Request processed in 98us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316901.569619:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10227 00010000:00010000:0.0:1767316901.569723:0:63840:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316901.569729:0:63840:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.569735:0:63840:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2dc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316901.569739:0:63840:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.569758:0:63840:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.569764:0:63840:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.569849:0:63840:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 2/0,0 mode: --/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.569856:0:63840:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316901.569888:0:63840:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 1/0,0 mode: --/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.569896:0:63840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56d49 lrc: 0/0,0 mode: --/PR res: [0x240000406:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acd22 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.569917:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.569919:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.569921:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316901.570290:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894058240:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316901.574876:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894058240:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316901.591469:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894057984:192.168.202.121@tcp:36:rm.0 00000080:00200000:2.0:1767316901.591521:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x67:0x0](ffff9cfe0edb4b08) 00000080:00200000:2.0:1767316901.591630:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316901.591660:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.591725:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.591737:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.591746:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316901.591788:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894058368:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316901.591880:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.599418:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894058368:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316901.599445:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.599458:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.599471:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.599481:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.599492:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.599500:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.599506:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316901.599517:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe29108000 x1853163894058368/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316901.599530:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.599569:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1767316901.599577:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767316901.599610:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767316901.599616:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d57 00000080:00010000:2.0:1767316901.599629:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316901.599633:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d57 from it ffffa99f40d87b58 00010000:00010000:2.0:1767316901.599636:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.599645:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316901.599668:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316901.599688:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d204b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:2.0:1767316901.599693:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d204b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:2.0:1767316901.599717:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d204b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.599758:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.599766:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.599775:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316901.599795:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894058496:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316901.599928:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.610036:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894058496:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316901.610076:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.610143:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.610151:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.610161:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.610172:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.610183:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.610191:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.610198:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316901.610209:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe29108000 x1853163894058496/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/672 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316901.610223:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.610233:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/106 (0 0) 00000080:00200000:2.0:1767316901.610249:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767316901.610290:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x6a:0x0](ffff9cfe0eda21c8) 00000002:00010000:2.0:1767316901.610318:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x8:0x0]) in obj [0x200000bd0:0x8:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.610379:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.610387:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.610394:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316901.610414:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910aa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894058624:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316901.610491:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.614384:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910aa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894058624:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316901.614409:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.614422:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.614434:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.614445:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.614457:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.614484:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.614491:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316901.614502:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe2910aa00 x1853163894058624/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316901.614514:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.614528:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589937616/8 (0 0) 00010000:00010000:2.0:1767316901.614536:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.614686:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316901.614714:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x8:0x0]) in obj [0x240000406:0x8:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316901.614760:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 3/1,0 mode: --/CR res: [0x240000406:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.614766:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 3/1,0 mode: --/CR res: [0x240000406:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316901.614774:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 3/1,0 mode: --/CR res: [0x240000406:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316901.614796:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910aa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894058752:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316901.614946:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.631604:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910aa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894058752:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.631632:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 4/1,0 mode: --/CR res: [0x240000406:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.631645:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 4/1,0 mode: --/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.631656:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.631689:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.631701:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 5/2,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.631709:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 5/2,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.631715:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.631727:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe2910aa00 x1853163894058752/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.631741:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.631754:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677446/8 (0 0) 00010000:00010000:0.0:1767316901.631763:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.631769:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.631807:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x6a:0x0], updating i_size 8192 00000080:00010000:0.0:1767316901.631818:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6a:0x0](ffff9cfe0eda21c8) for lock 0xd9a0da65fad56d5e 00000080:00010000:0.0:1767316901.631830:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6a:0x0](ffff9cfe0eda21c8) 00000080:00010000:0.0:1767316901.631845:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d5e from it ffffa99f40d87b20 00010000:00010000:0.0:1767316901.631855:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.631863:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316901.631895:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d204b.sanity-flr:[0x200000405:0x6a:0x0](ffff9cfe0eda21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316901.631902:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x6a:0x0](ffff9cfe0eda21c8),name=d204b.sanity-flr 00000002:00010000:0.0:1767316901.631938:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.631948:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.631958:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.631966:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x8:0x0]) in obj [0x200000bd0:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.631972:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.631979:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.631987:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.631994:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.632002:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x8:0x0]) in obj [0x240000406:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.632007:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.632021:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.632029:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.632035:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.632046:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316901.632050:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6a:0x0](ffff9cfe0eda21c8) 00000080:00010000:0.0:1767316901.632054:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6a:0x0](ffff9cfe0eda21c8) for lock 0xd9a0da65fad56d5e 00000080:00010000:0.0:1767316901.632057:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d5e from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316901.632060:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.632067:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.632106:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x8:0x0]) in obj [0x200000bd0:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.632112:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.632120:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.632126:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.632145:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.632155:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x8:0x0]) in obj [0x240000406:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.632160:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.632168:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.632175:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.632181:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.632235:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316901.632244:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.632250:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.632258:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.632263:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316901.632267:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316901.632269:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d57 00000080:00010000:0.0:1767316901.632272:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d57 from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316901.632281:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.632288:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.632295:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316901.632303:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204b.sanity-flr, flags=266 00000080:00200000:0.0:1767316901.632308:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x6a:0x0](ffff9cfe0eda21c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767316901.632316:0:83725:0:(file.c:1001:ll_file_open()) START file d204b.sanity-flr:[0x200000405:0x6a:0x0](ffff9cfe0eda21c8), flags 704400 00000002:00010000:0.0:1767316901.632332:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6a:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316901.632378:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56d73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.632385:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56d73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316901.632397:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316901.632405:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9500 x1853163894059008/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316901.632414:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56d73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.632437:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894059008:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.632612:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.636134:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894059008:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.636158:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56d73 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.636172:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56d73 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.636196:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56d73 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.636202:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56d73 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.636209:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56d73 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.636215:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316901.636219:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56d73 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.636225:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56d73 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.636232:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56d73 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.636238:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316901.636244:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56d73 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.636250:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56d73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316901.636269:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe191d9500 x1853163894059008/t8589937465(8589937465) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316901.636282:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d9500 x1853163894059008/t8589937465(8589937465) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316901.636299:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316901.636336:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x6a:0x0], updating i_size 4096 00000002:00100000:0.0:1767316901.636355:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d9500 x1853163894059008/t8589937465(8589937465) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316901.636416:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d204b.sanity-flr:[0x200000405:0x6a:0x0](ffff9cfe0eda21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316901.636424:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x6a:0x0](ffff9cfe0eda21c8),name=d204b.sanity-flr 00000002:00010000:0.0:1767316901.636445:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.636459:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.636470:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.636479:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x8:0x0]) in obj [0x200000bd0:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.636485:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.636492:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.636500:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.636507:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.636521:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x8:0x0]) in obj [0x240000406:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.636527:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.636558:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.636566:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.636573:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.636883:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316901.636895:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6a:0x0](ffff9cfe0eda21c8) 00000080:00010000:0.0:1767316901.636898:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6a:0x0](ffff9cfe0eda21c8) for lock 0xd9a0da65fad56d5e 00000080:00010000:0.0:1767316901.636903:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d5e from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316901.636907:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.636914:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.636940:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x8:0x0]) in obj [0x200000bd0:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.636946:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.636953:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.636960:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.636976:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.636984:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x8:0x0]) in obj [0x240000406:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.636989:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.636996:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.637002:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.637008:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.637034:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x6a:0x0](ffff9cfe0eda21c8) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767316901.637046:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.637069:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x8:0x0]) in obj [0x200000bd0:0x8:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316901.637075:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.637128:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316901.638173:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894059136:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316901.638278:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.645169:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894059136:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316901.645893:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.645909:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.645938:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x8:0x0]) in obj [0x240000406:0x8:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316901.645953:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.645966:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316901.647908:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894059264:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316901.648023:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.655753:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894059264:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316901.656412:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.656427:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.656486:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x6a:0x0](ffff9cfe0eda21c8) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:1.0:1767316901.656504:0:83725:0:(file.c:424:ll_file_release()) START file d204b.sanity-flr:[0x200000405:0x6a:0x0](ffff9cfe0eda21c8), flags 704000 00000002:00100000:1.0:1767316901.656568:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191d9500 x1853163894059008/t8589937465(8589937465) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316901.656579:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316901.656741:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3d500 x1853163894059520/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316901.656767:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894059520:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316901.656930:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.666447:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894059520:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316901.666486:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191d9500 x1853163894059008/t8589937465(8589937465) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316901.666558:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316901.666600:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.666617:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.666629:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.666636:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316901.666643:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316901.666646:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d57 00000080:00010000:1.0:1767316901.666652:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d57 from it ffffa99f40d87c10 00010000:00010000:1.0:1767316901.666656:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.666664:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.666679:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316901.666689:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204b.sanity-flr, flags=0 00000080:00200000:1.0:1767316901.666695:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316901.666703:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.666709:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.666717:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.666723:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316901.666727:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316901.666729:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d57 00000080:00010000:1.0:1767316901.666741:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d57 from it ffffa99f40d87d88 00010000:00010000:1.0:1767316901.666745:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.666752:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.666760:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316901.666766:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d204b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316901.666786:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.666810:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.666860:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 1/0,0 mode: --/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.666867:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.666872:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316901.666874:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095e00/0xd9a0da65fad56d5e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acd84 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.666887:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad56d57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acd68 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316901.666904:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316901.666910:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3d500 x1853163894059776/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316901.666938:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894059776:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316901.667014:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:3.0:1767316901.670850:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316901.671063:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939807232 00000100:00100000:2.0:1767316901.671076:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939807232 00000100:00100000:2.0:1767316901.671176:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10228 00000100:00100000:2.0:1767316901.671187:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939807232:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316901.671205:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.671287:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316901.671294:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939807232:12345-192.168.202.121@tcp:104: Request processed in 109us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316901.671301:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10228 00010000:00010000:0.0:1767316901.671738:0:42048:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316901.671746:0:42048:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.671754:0:42048:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05095600 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316901.671759:0:42048:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.671767:0:42048:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.671775:0:42048:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.671929:0:42048:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.671936:0:42048:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316901.671963:0:42048:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.671969:0:42048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56d65 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acd92 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.671986:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.671988:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.671990:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316901.672040:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894059904:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316901.677285:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894059904:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316901.678683:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316901.678900:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939807488 00000100:00100000:3.0:1767316901.678911:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939807488 00000100:00100000:3.0:1767316901.678975:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10229 00000100:00100000:3.0:1767316901.678984:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939807488:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316901.679002:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.679111:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316901.679119:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939807488:12345-192.168.202.121@tcp:104: Request processed in 136us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316901.679127:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10229 00010000:00010000:0.0:1767316901.679339:0:49629:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316901.679347:0:49629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.679357:0:49629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05095800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316901.679363:0:49629:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.679372:0:49629:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.679380:0:49629:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.679492:0:49629:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 2/0,0 mode: --/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.679516:0:49629:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316901.679555:0:49629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 1/0,0 mode: --/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.679562:0:49629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad56d6c lrc: 0/0,0 mode: --/PR res: [0x240000406:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acda0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.679579:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.679591:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.679593:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316901.679602:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316901.679616:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894060032:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316901.684982:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894060032:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316901.694419:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894059776:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316901.694462:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x6a:0x0](ffff9cfe0eda21c8) 00000080:00200000:1.0:1767316901.694538:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316901.694558:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.694624:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.694633:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.694643:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.694661:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894060160:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.694734:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.697827:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894060160:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.697863:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.697875:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.697907:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.697930:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.697943:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.697951:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.697958:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.697969:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3fb80 x1853163894060160/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.697982:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.697995:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316901.698002:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316901.698028:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316901.698035:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d7a 00000080:00010000:1.0:1767316901.698039:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316901.698043:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d7a from it ffffa99f40d87b58 00010000:00010000:1.0:1767316901.698046:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.698059:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.698113:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316901.698134:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d204c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316901.698139:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d204c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316901.698161:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d204c.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.698212:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.698219:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.698228:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.698248:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894060288:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.698389:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.702424:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894060288:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.702450:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.702472:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.702480:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.702509:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.702520:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.702531:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.702539:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.702545:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.702555:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3fb80 x1853163894060288/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/672 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.702568:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.702579:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/107 (0 0) 00000080:00200000:1.0:1767316901.702655:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316901.702700:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x6b:0x0](ffff9cfe0edb00c8) 00000002:00010000:1.0:1767316901.702723:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x9:0x0]) in obj [0x200000bd0:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.702771:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.702778:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.702794:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.702815:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894060416:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.703034:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.705304:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894060416:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.705326:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.705337:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.705347:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.705357:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.705367:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.705375:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.705382:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.705391:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3ce00 x1853163894060416/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.705417:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.705429:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589937616/9 (0 0) 00010000:00010000:1.0:1767316901.705436:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.705443:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.705471:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x9:0x0]) in obj [0x240000406:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.705510:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 3/1,0 mode: --/CR res: [0x240000406:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.705516:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 3/1,0 mode: --/CR res: [0x240000406:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.705525:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 3/1,0 mode: --/CR res: [0x240000406:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.705542:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894060544:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.705610:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.708131:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894060544:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.708154:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 4/1,0 mode: --/CR res: [0x240000406:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708165:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 4/1,0 mode: --/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708206:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708215:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708226:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 5/2,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708233:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 5/2,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708240:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.708249:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3ce00 x1853163894060544/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.708262:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708274:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677446/9 (0 0) 00010000:00010000:1.0:1767316901.708281:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708288:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.708325:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x6b:0x0], updating i_size 8192 00000080:00010000:1.0:1767316901.708341:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6b:0x0](ffff9cfe0edb00c8) for lock 0xd9a0da65fad56d81 00000080:00010000:1.0:1767316901.708354:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6b:0x0](ffff9cfe0edb00c8) 00000080:00010000:1.0:1767316901.708357:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d81 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316901.708361:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708368:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316901.708401:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d204c.sanity-flr:[0x200000405:0x6b:0x0](ffff9cfe0edb00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316901.708407:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x6b:0x0](ffff9cfe0edb00c8),name=d204c.sanity-flr 00000002:00010000:1.0:1767316901.708429:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6b:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.708438:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708448:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.708457:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x9:0x0]) in obj [0x200000bd0:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.708462:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708470:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708476:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708482:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.708500:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x9:0x0]) in obj [0x240000406:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.708505:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708512:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708519:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708525:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.708534:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316901.708538:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6b:0x0](ffff9cfe0edb00c8) 00000080:00010000:1.0:1767316901.708541:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6b:0x0](ffff9cfe0edb00c8) for lock 0xd9a0da65fad56d81 00000080:00010000:1.0:1767316901.708545:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d81 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316901.708548:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708555:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.708566:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x9:0x0]) in obj [0x200000bd0:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.708572:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708580:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708723:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708729:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.708738:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x9:0x0]) in obj [0x240000406:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.708743:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708751:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708757:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708763:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.708824:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316901.708846:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.708854:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708861:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.708867:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316901.708870:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316901.708879:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d7a 00000080:00010000:1.0:1767316901.708883:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d7a from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316901.708886:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.708893:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.708901:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316901.708907:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204c.sanity-flr, flags=266 00000080:00200000:1.0:1767316901.708913:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x6b:0x0](ffff9cfe0edb00c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767316901.708921:0:83725:0:(file.c:1001:ll_file_open()) START file d204c.sanity-flr:[0x200000405:0x6b:0x0](ffff9cfe0edb00c8), flags 704400 00000002:00010000:1.0:1767316901.708936:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6b:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767316901.708988:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56d96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.708995:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56d96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316901.709007:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316901.709014:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3fb80 x1853163894060800/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316901.709024:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56d96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.709049:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894060800:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.709581:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.713153:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894060800:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.713178:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56d96 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.713301:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56d96 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.713308:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56d96 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.713314:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56d96 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.713321:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56d96 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.713327:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2ce00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316901.713332:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56d96 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.713338:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56d96 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.713345:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56d96 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.713352:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316901.713358:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56d96 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.713363:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56d96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:1.0:1767316901.713382:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe18f3fb80 x1853163894060800/t8589937468(8589937468) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316901.713396:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3fb80 x1853163894060800/t8589937468(8589937468) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316901.713420:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316901.713451:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x6b:0x0], updating i_size 4096 00000002:00100000:1.0:1767316901.713470:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3fb80 x1853163894060800/t8589937468(8589937468) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316901.713539:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d204c.sanity-flr:[0x200000405:0x6b:0x0](ffff9cfe0edb00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316901.713547:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x6b:0x0](ffff9cfe0edb00c8),name=d204c.sanity-flr 00000002:00010000:1.0:1767316901.713567:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6b:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.713581:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.713671:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.713682:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x9:0x0]) in obj [0x200000bd0:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.713689:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.713695:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.713703:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.713710:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.713725:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x9:0x0]) in obj [0x240000406:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.713731:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.713747:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.713754:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.713761:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.713771:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316901.713776:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6b:0x0](ffff9cfe0edb00c8) 00000080:00010000:1.0:1767316901.713780:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6b:0x0](ffff9cfe0edb00c8) for lock 0xd9a0da65fad56d81 00000080:00010000:1.0:1767316901.713784:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d81 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316901.713787:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.713793:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.713803:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x9:0x0]) in obj [0x200000bd0:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.713808:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.713815:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.713821:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.713850:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.713859:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x9:0x0]) in obj [0x240000406:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.713864:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.713871:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.713878:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.713884:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.713910:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x6b:0x0](ffff9cfe0edb00c8) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767316901.714015:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.714039:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x9:0x0]) in obj [0x200000bd0:0x9:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316901.714046:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.714054:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316901.715328:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894060928:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316901.715486:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.724400:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894060928:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316901.725170:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.725356:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.725380:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x9:0x0]) in obj [0x240000406:0x9:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316901.725393:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.725405:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316901.726855:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894061056:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316901.727120:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.733637:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894061056:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316901.734273:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.734288:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.734343:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x6b:0x0](ffff9cfe0edb00c8) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:1.0:1767316901.734361:0:83725:0:(file.c:424:ll_file_release()) START file d204c.sanity-flr:[0x200000405:0x6b:0x0](ffff9cfe0edb00c8), flags 704000 00000002:00100000:1.0:1767316901.734417:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3fb80 x1853163894060800/t8589937468(8589937468) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316901.734436:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316901.734441:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3ce00 x1853163894061312/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316901.734463:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894061312:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316901.734536:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.738527:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894061312:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316901.738564:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3fb80 x1853163894060800/t8589937468(8589937468) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316901.739383:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316901.739407:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.739427:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.739441:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.739450:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316901.739455:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316901.739459:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d7a 00000080:00010000:1.0:1767316901.739466:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d7a from it ffffa99f40d87c10 00010000:00010000:1.0:1767316901.739470:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.739478:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.739515:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316901.739525:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204c.sanity-flr, flags=0 00000080:00200000:1.0:1767316901.739531:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316901.739540:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.739546:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.739554:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.739560:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316901.739565:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316901.739567:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d7a 00000080:00010000:1.0:1767316901.739571:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d7a from it ffffa99f40d87d88 00010000:00010000:1.0:1767316901.739574:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.739581:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.739666:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316901.739672:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d204c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316901.739693:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.739719:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.739769:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.739777:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.739783:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316901.739786:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56d81 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x6b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ace02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.739801:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56d7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acde6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316901.739817:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316901.739826:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3ce00 x1853163894061568/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316901.739859:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894061568:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316901.740019:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:2.0:1767316901.742697:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316901.742802:0:42041:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767316901.742822:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939808512 00000100:00100000:3.0:1767316901.742841:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939808512 00000100:00100000:3.0:1767316901.742896:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10230 00000100:00100000:3.0:1767316901.742905:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29095050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939808512:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316901.742930:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.742998:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316901.743005:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29095050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939808512:12345-192.168.202.121@tcp:104: Request processed in 101us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316901.743011:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10230 00010000:00010000:1.0:1767316901.744275:0:63296:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316901.744287:0:63296:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.744298:0:63296:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316901.744302:0:63296:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.744310:0:63296:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.744332:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.744450:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.744457:0:63296:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316901.744487:0:63296:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.744495:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d88 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ace10 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.744511:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316901.744514:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316901.744516:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316901.744524:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316901.744542:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894061696:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316901.751401:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316901.751471:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939808768 00000100:00100000:3.0:1767316901.751481:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939808768 00000100:00100000:3.0:1767316901.751541:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10231 00000100:00100000:3.0:1767316901.751552:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939808768:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316901.751569:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.751657:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316901.751665:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939808768:12345-192.168.202.121@tcp:104: Request processed in 115us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316901.751672:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10231 00010000:00010000:0.0:1767316901.751870:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316901.751879:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.751887:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2cc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316901.751892:0:63142:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.751900:0:63142:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.751907:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.752037:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 2/0,0 mode: --/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.752043:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316901.752061:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 1/0,0 mode: --/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.752069:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56d8f lrc: 0/0,0 mode: --/PR res: [0x240000406:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ace1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.752103:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.752105:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.752107:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316901.752114:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316901.752129:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894061824:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316901.759383:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894061824:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316901.760072:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894061696:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316901.770402:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894061568:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316901.770445:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x6b:0x0](ffff9cfe0edb00c8) 00000080:00200000:1.0:1767316901.770530:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316901.770551:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.770782:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.770792:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.770819:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.770850:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894061952:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.771122:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.774771:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894061952:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.774797:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.774808:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.774820:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.774840:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.774853:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.774860:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.774867:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.774879:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3fb80 x1853163894061952/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.774908:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.774932:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316901.774939:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316901.774971:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316901.774978:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d9d 00000080:00010000:1.0:1767316901.774983:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316901.774986:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d9d from it ffffa99f40d87b58 00010000:00010000:1.0:1767316901.774989:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.774998:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.775025:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316901.775045:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d204d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316901.775049:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d204d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316901.775071:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d204d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.775145:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.775152:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.775161:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.775586:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894062080:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.775967:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac780 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.780110:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894062080:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.780138:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.780160:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.780168:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.780196:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.780208:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.780220:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.780228:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.780235:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.780245:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3fb80 x1853163894062080/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/672 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.780259:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.780269:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/110 (0 0) 00000080:00200000:0.0:1767316901.780275:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316901.780314:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x6e:0x0](ffff9cfe187ddb88) 00000002:00010000:0.0:1767316901.780337:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xa:0x0]) in obj [0x200000bd0:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.780381:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.780388:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.780402:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.780421:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894062208:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.780502:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.782966:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894062208:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.782990:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.783000:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.783009:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.783019:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.783029:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.783035:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.783042:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.783053:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191dad80 x1853163894062208/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.783116:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.783129:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589937616/10 (0 0) 00010000:00010000:0.0:1767316901.783137:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.783145:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.783172:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xa:0x0]) in obj [0x240000406:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.783222:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 3/1,0 mode: --/CR res: [0x240000406:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.783229:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 3/1,0 mode: --/CR res: [0x240000406:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.783237:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 3/1,0 mode: --/CR res: [0x240000406:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.783257:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894062336:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.783327:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.786339:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894062336:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.786364:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 4/1,0 mode: --/CR res: [0x240000406:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786375:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 4/1,0 mode: --/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786404:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786415:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786428:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786436:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786444:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.786455:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191dad80 x1853163894062336/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.786469:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786482:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677446/10 (0 0) 00010000:00010000:0.0:1767316901.786490:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786496:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.786529:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x6e:0x0], updating i_size 8192 00000080:00010000:0.0:1767316901.786548:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6e:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56da4 00000080:00010000:0.0:1767316901.786562:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6e:0x0](ffff9cfe187ddb88) 00000080:00010000:0.0:1767316901.786565:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56da4 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316901.786569:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786578:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316901.786621:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d204d.sanity-flr:[0x200000405:0x6e:0x0](ffff9cfe187ddb88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316901.786628:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x6e:0x0](ffff9cfe187ddb88),name=d204d.sanity-flr 00000002:00010000:0.0:1767316901.786651:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.786660:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786670:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.786679:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xa:0x0]) in obj [0x200000bd0:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.786685:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786692:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786699:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786705:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.786720:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xa:0x0]) in obj [0x240000406:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.786726:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786734:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786741:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786747:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.786755:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316901.786759:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6e:0x0](ffff9cfe187ddb88) 00000080:00010000:0.0:1767316901.786762:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6e:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56da4 00000080:00010000:0.0:1767316901.786765:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56da4 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316901.786768:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786774:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.786784:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xa:0x0]) in obj [0x200000bd0:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.786789:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786796:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786810:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786817:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.786825:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xa:0x0]) in obj [0x240000406:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.786830:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786848:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786856:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.786862:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.787007:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316901.787018:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.787025:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.787033:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.787038:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316901.787042:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316901.787050:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d9d 00000080:00010000:0.0:1767316901.787055:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d9d from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316901.787058:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.787065:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.787073:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316901.787186:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204d.sanity-flr, flags=266 00000080:00200000:0.0:1767316901.787193:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x6e:0x0](ffff9cfe187ddb88), inode mode 41ed mask 44 00000080:00200008:0.0:1767316901.787201:0:83725:0:(file.c:1001:ll_file_open()) START file d204d.sanity-flr:[0x200000405:0x6e:0x0](ffff9cfe187ddb88), flags 704400 00000002:00010000:0.0:1767316901.787218:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316901.787262:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56db9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.787269:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56db9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316901.787279:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316901.787287:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191dad80 x1853163894062592/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316901.787295:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56db9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.787315:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894062592:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.787477:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.792362:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894062592:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.792386:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56db9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.792411:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56db9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.792418:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56db9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.792424:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56db9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.792431:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56db9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.792437:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c600 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316901.792441:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56db9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.792448:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56db9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.792455:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56db9 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.792461:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316901.792468:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56db9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.792474:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56db9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316901.792492:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe191dad80 x1853163894062592/t8589937471(8589937471) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316901.792504:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191dad80 x1853163894062592/t8589937471(8589937471) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316901.792528:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316901.792558:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x6e:0x0], updating i_size 4096 00000002:00100000:0.0:1767316901.792575:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191dad80 x1853163894062592/t8589937471(8589937471) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316901.792652:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d204d.sanity-flr:[0x200000405:0x6e:0x0](ffff9cfe187ddb88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316901.792659:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x6e:0x0](ffff9cfe187ddb88),name=d204d.sanity-flr 00000002:00010000:0.0:1767316901.792679:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.792694:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.792706:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.792716:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xa:0x0]) in obj [0x200000bd0:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.792722:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.792729:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.792738:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.792744:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.792758:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xa:0x0]) in obj [0x240000406:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.792765:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.792779:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.792787:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.792794:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.792803:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316901.792809:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6e:0x0](ffff9cfe187ddb88) 00000080:00010000:0.0:1767316901.792812:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6e:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56da4 00000080:00010000:0.0:1767316901.792816:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56da4 from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316901.792819:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.792825:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.792848:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xa:0x0]) in obj [0x200000bd0:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.792854:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.792862:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.792870:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.792889:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.792898:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xa:0x0]) in obj [0x240000406:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.792903:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.792910:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.793072:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.793332:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.793363:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x6e:0x0](ffff9cfe187ddb88) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767316901.793376:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.793398:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xa:0x0]) in obj [0x200000bd0:0xa:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316901.793405:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.793413:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316901.794040:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894062720:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316901.794165:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.802732:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894062720:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316901.803808:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.803827:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.803861:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xa:0x0]) in obj [0x240000406:0xa:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316901.803875:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.803888:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316901.804859:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894062848:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316901.805506:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.814024:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894062848:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316901.815295:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.815314:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.815370:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x6e:0x0](ffff9cfe187ddb88) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:1.0:1767316901.815388:0:83725:0:(file.c:424:ll_file_release()) START file d204d.sanity-flr:[0x200000405:0x6e:0x0](ffff9cfe187ddb88), flags 704000 00000002:00100000:1.0:1767316901.815451:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191dad80 x1853163894062592/t8589937471(8589937471) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316901.815481:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316901.815488:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3fb80 x1853163894063104/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316901.815511:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894063104:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316901.815607:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.820754:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894063104:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316901.820795:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191dad80 x1853163894062592/t8589937471(8589937471) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316901.820878:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316901.820899:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.820929:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.820942:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.820950:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316901.820956:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316901.820960:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d9d 00000080:00010000:1.0:1767316901.820966:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d9d from it ffffa99f40d87c10 00010000:00010000:1.0:1767316901.820971:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.820980:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.821013:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316901.821024:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204d.sanity-flr, flags=0 00000080:00200000:1.0:1767316901.821030:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316901.821037:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.821044:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.821052:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.821059:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316901.821062:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316901.821065:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56d9d 00000080:00010000:1.0:1767316901.821068:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56d9d from it ffffa99f40d87d88 00010000:00010000:1.0:1767316901.821071:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.821210:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.821220:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316901.821227:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d204d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316901.821248:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.821274:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.821321:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.821328:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.821333:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316901.821335:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56da4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x6e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ace80 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.821349:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56d9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ace64 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316901.821366:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316901.821373:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3fb80 x1853163894063360/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316901.821394:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894063360:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316901.821475:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1767316901.826026:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316901.826135:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939809792 00000100:00100000:2.0:1767316901.826146:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939809792 00000100:00100000:2.0:1767316901.826222:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10232 00000100:00100000:2.0:1767316901.826233:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939809792:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316901.826254:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.826344:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316901.826351:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939809792:12345-192.168.202.121@tcp:104: Request processed in 120us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316901.826359:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10232 00010000:00010000:0.0:1767316901.826755:0:63143:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316901.826764:0:63143:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.826773:0:63143:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316901.826778:0:63143:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.826789:0:63143:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.826796:0:63143:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.826923:0:63143:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.826930:0:63143:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316901.826967:0:63143:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.826975:0:63143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56dab lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ace8e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.826991:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.826993:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.826995:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316901.827005:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316901.827020:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894063488:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316901.835404:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316901.835492:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939810048 00000100:00100000:3.0:1767316901.835502:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939810048 00000100:00100000:3.0:1767316901.835552:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10233 00000100:00100000:3.0:1767316901.835562:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939810048:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316901.835579:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.835793:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316901.835802:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939810048:12345-192.168.202.121@tcp:104: Request processed in 240us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316901.835809:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10233 00010000:00010000:1.0:1767316901.837029:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316901.837042:0:59093:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.837055:0:59093:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037ca00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316901.837060:0:59093:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.837069:0:59093:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.837399:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.837511:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 2/0,0 mode: --/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.837518:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316901.837538:0:59093:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 1/0,0 mode: --/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.837545:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56db2 lrc: 0/0,0 mode: --/PR res: [0x240000406:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ace9c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.837562:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316901.837564:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316901.837566:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316901.837574:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316901.837731:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894063488:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316901.837882:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894063616:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316901.853453:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894063616:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316901.859678:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894063360:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316901.859723:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x6e:0x0](ffff9cfe187ddb88) 00000080:00200000:1.0:1767316901.859809:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316901.859840:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.859904:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.859914:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.859939:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.859958:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894063744:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.860043:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.863274:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894063744:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.863302:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.863314:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.863327:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.863338:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.863350:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.863356:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.863363:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.863375:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3f100 x1853163894063744/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.863404:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.863417:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316901.863424:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316901.863449:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316901.863456:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56dc0 00000080:00010000:1.0:1767316901.863461:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316901.863463:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56dc0 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316901.863467:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.863475:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.863504:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316901.863525:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d204e.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316901.863536:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d204e.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316901.863562:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d204e.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.863616:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.863623:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.863632:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.863653:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894063872:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.863736:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.867520:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894063872:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.867552:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.867576:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.867593:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.867604:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.867615:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.867628:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.867636:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.867645:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.867656:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3f100 x1853163894063872/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/672 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.867670:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.867700:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/111 (0 0) 00000080:00200000:1.0:1767316901.867708:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316901.867744:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x6f:0x0](ffff9cfe0edb00c8) 00000002:00010000:1.0:1767316901.867764:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xb:0x0]) in obj [0x200000bd0:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.867800:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.867805:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.867811:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.867825:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894064000:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.868034:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.876518:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894064000:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.876550:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.876563:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.876575:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.876595:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.876608:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.876631:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.876638:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.876649:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3ea00 x1853163894064000/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.876662:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.876675:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589937616/11 (0 0) 00010000:00010000:1.0:1767316901.876683:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.876691:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.876723:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xb:0x0]) in obj [0x240000406:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.876770:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 3/1,0 mode: --/CR res: [0x240000406:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.876778:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 3/1,0 mode: --/CR res: [0x240000406:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.876786:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 3/1,0 mode: --/CR res: [0x240000406:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.876808:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894064128:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.876899:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.882280:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894064128:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.882308:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 4/1,0 mode: --/CR res: [0x240000406:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.882320:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 4/1,0 mode: --/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.882332:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.882343:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.882355:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.882363:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.882370:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316901.882380:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3ea00 x1853163894064128/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316901.882392:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.882405:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677446/11 (0 0) 00010000:00010000:1.0:1767316901.882428:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.882436:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.882476:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x6f:0x0], updating i_size 8192 00000080:00010000:1.0:1767316901.882488:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6f:0x0](ffff9cfe0edb00c8) for lock 0xd9a0da65fad56dc7 00000080:00010000:1.0:1767316901.882501:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6f:0x0](ffff9cfe0edb00c8) 00000080:00010000:1.0:1767316901.882505:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56dc7 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316901.882508:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.882522:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316901.882557:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d204e.sanity-flr:[0x200000405:0x6f:0x0](ffff9cfe0edb00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316901.882565:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x6f:0x0](ffff9cfe0edb00c8),name=d204e.sanity-flr 00000002:00010000:1.0:1767316901.882995:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6f:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.883005:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883013:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.883019:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xb:0x0]) in obj [0x200000bd0:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.883023:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883036:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883041:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883045:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.883051:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xb:0x0]) in obj [0x240000406:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.883055:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883060:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883066:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883073:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.883263:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316901.883268:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6f:0x0](ffff9cfe0edb00c8) 00000080:00010000:1.0:1767316901.883271:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6f:0x0](ffff9cfe0edb00c8) for lock 0xd9a0da65fad56dc7 00000080:00010000:1.0:1767316901.883274:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56dc7 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316901.883276:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883333:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.883343:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xb:0x0]) in obj [0x200000bd0:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.883347:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883352:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883357:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883362:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.883365:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xb:0x0]) in obj [0x240000406:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.883368:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883371:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883375:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883379:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.883431:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316901.883440:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.883446:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883453:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.883459:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316901.883462:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316901.883464:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56dc0 00000080:00010000:1.0:1767316901.883468:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56dc0 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316901.883471:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.883477:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.883486:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316901.883493:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204e.sanity-flr, flags=266 00000080:00200000:1.0:1767316901.883499:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x6f:0x0](ffff9cfe0edb00c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767316901.883510:0:83725:0:(file.c:1001:ll_file_open()) START file d204e.sanity-flr:[0x200000405:0x6f:0x0](ffff9cfe0edb00c8), flags 704400 00000002:00010000:1.0:1767316901.883524:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6f:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767316901.883564:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ddc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.883569:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ddc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316901.884178:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316901.884428:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f100 x1853163894064384/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316901.884440:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ddc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316901.884467:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894064384:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316901.884870:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.889414:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894064384:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316901.889439:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ddc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.889453:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ddc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.889459:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ddc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.889465:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ddc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.889472:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ddc lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.889478:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316901.889482:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ddc lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.889488:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ddc lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.889515:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ddc lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.889521:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316901.889527:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ddc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316901.889640:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56ddc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:1.0:1767316901.889660:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe18f3f100 x1853163894064384/t8589937474(8589937474) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316901.889672:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f100 x1853163894064384/t8589937474(8589937474) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316901.889688:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316901.889718:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x6f:0x0], updating i_size 4096 00000002:00100000:1.0:1767316901.889736:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f100 x1853163894064384/t8589937474(8589937474) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316901.889798:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d204e.sanity-flr:[0x200000405:0x6f:0x0](ffff9cfe0edb00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316901.889804:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x6f:0x0](ffff9cfe0edb00c8),name=d204e.sanity-flr 00000002:00010000:1.0:1767316901.889823:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x6f:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.889847:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.889859:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.889869:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xb:0x0]) in obj [0x200000bd0:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.889881:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.889888:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.889895:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.889902:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.890007:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xb:0x0]) in obj [0x240000406:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.890015:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.890023:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.890030:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.890036:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.890045:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316901.890051:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x6f:0x0](ffff9cfe0edb00c8) 00000080:00010000:1.0:1767316901.890054:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6f:0x0](ffff9cfe0edb00c8) for lock 0xd9a0da65fad56dc7 00000080:00010000:1.0:1767316901.890059:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56dc7 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316901.890062:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.890075:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.890202:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xb:0x0]) in obj [0x200000bd0:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.890209:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.890217:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.890223:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.890229:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.890237:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xb:0x0]) in obj [0x240000406:0xb:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316901.890241:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.890247:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.890253:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.890258:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316901.890298:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x6f:0x0](ffff9cfe0edb00c8) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767316901.890309:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316901.890330:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xb:0x0]) in obj [0x200000bd0:0xb:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316901.890336:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.890343:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316901.891035:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894064512:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316901.891271:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316901.897700:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894064512:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316901.898562:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316901.898579:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.898789:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xb:0x0]) in obj [0x240000406:0xb:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316901.898807:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.898819:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316901.899673:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894064640:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316901.899778:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.906218:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894064640:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316901.906857:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.906872:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.906941:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x6f:0x0](ffff9cfe0edb00c8) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:0.0:1767316901.906960:0:83725:0:(file.c:424:ll_file_release()) START file d204e.sanity-flr:[0x200000405:0x6f:0x0](ffff9cfe0edb00c8), flags 704000 00000002:00100000:0.0:1767316901.907022:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3f100 x1853163894064384/t8589937474(8589937474) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316901.907035:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316901.907040:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191daa00 x1853163894064896/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316901.907062:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894064896:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316901.907194:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.912846:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894064896:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316901.912887:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3f100 x1853163894064384/t8589937474(8589937474) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316901.913060:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316901.913239:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.913259:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.913274:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.913282:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316901.913288:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316901.913292:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56dc0 00000080:00010000:0.0:1767316901.913298:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56dc0 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316901.913303:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.913312:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.913327:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316901.913340:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204e.sanity-flr, flags=0 00000080:00200000:0.0:1767316901.913346:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316901.913355:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.913361:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.913388:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.913394:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316901.913398:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316901.913401:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56dc0 00000080:00010000:0.0:1767316901.913404:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56dc0 from it ffffa99f40d87d88 00010000:00010000:0.0:1767316901.913407:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.913414:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.913423:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316901.913429:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d204e.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316901.913449:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.913472:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.913506:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.913513:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.913518:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316901.913527:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56dc7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acefe expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.913543:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56dc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acee2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316901.913562:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316901.913570:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191daa00 x1853163894065152/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316901.913610:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894065152:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316901.913717:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1767316901.917774:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316901.917810:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939811072 00000100:00100000:3.0:1767316901.917820:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939811072 00000100:00100000:3.0:1767316901.917881:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10234 00000100:00100000:3.0:1767316901.917892:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15468:x1853163939811072:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316901.917936:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316901.918590:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316901.918600:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15468:x1853163939811072:12345-192.168.202.121@tcp:104: Request processed in 709us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316901.918608:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10234 00010000:00010000:0.0:1767316901.920661:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316901.920674:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.920687:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2ca00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316901.920692:0:42049:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.920701:0:42049:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.920709:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.920886:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.920893:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767316901.921057:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894065280:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767316901.924003:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.924022:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56dce lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acf0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.924055:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.924057:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.924060:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316901.930825:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316901.930879:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939811328 00000100:00100000:2.0:1767316901.930890:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939811328 00000100:00100000:2.0:1767316901.930951:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10235 00000100:00100000:2.0:1767316901.930961:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939811328:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316901.930978:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316901.931056:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316901.931062:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939811328:12345-192.168.202.121@tcp:104: Request processed in 104us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316901.931070:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10235 00010000:00010000:0.0:1767316901.931445:0:63840:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316901.931453:0:63840:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.931463:0:63840:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2ce00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316901.931468:0:63840:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.931476:0:63840:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.931484:0:63840:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.931609:0:63840:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 2/0,0 mode: --/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.931616:0:63840:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316901.931634:0:63840:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 1/0,0 mode: --/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.931641:0:63840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56dd5 lrc: 0/0,0 mode: --/PR res: [0x240000406:0xb:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acf1a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.931669:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.931671:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316901.931673:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316901.931691:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894065408:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316901.937746:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894065408:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316901.937948:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894065280:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767316901.957313:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316901.967445:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191daa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894065152:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316901.967492:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x6f:0x0](ffff9cfe0edb00c8) 00000080:00200000:0.0:1767316901.967576:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316901.967609:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.967668:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.967679:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.967689:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.967708:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894065536:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.967793:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.977898:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894065536:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.977937:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.977950:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.977979:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.977990:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.978002:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.978010:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.978018:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.978029:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191da300 x1853163894065536/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.978042:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.978056:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316901.978064:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316901.978137:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316901.978156:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56de3 00000080:00010000:0.0:1767316901.978163:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316901.978166:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56de3 from it ffffa99f40d87b58 00010000:00010000:0.0:1767316901.978170:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.978195:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.978222:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316901.978243:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d204f.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316901.978247:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d204f.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316901.978274:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d204f.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.978319:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.978325:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.978334:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.978355:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894065664:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.978435:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.984779:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894065664:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.984806:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.984841:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 4/1,0 mode: --/PR res: [0x200000405:0x72:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.984850:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 4/1,0 mode: --/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.984882:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.984893:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.984907:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.984927:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.984933:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.984945:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191da300 x1853163894065664/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/672 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.984960:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.984971:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/114 (0 0) 00000080:00200000:0.0:1767316901.984977:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316901.985025:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x72:0x0](ffff9cfe187d8908) 00000002:00010000:0.0:1767316901.985060:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xc:0x0]) in obj [0x200000bd0:0xc:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.985156:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.985164:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.985198:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.985222:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894065792:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.985309:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.989249:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894065792:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.989279:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.989291:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.989304:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.989314:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.989325:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.989332:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.989339:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.989349:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d8700 x1853163894065792/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.989382:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.989395:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589937616/12 (0 0) 00010000:00010000:0.0:1767316901.989403:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.989411:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.989447:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xc:0x0]) in obj [0x240000406:0xc:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.989495:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 3/1,0 mode: --/CR res: [0x240000406:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.989502:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 3/1,0 mode: --/CR res: [0x240000406:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316901.989510:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 3/1,0 mode: --/CR res: [0x240000406:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316901.989530:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894065920:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316901.989902:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316901.996038:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894065920:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316901.996062:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 4/1,0 mode: --/CR res: [0x240000406:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.996073:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 4/1,0 mode: --/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999012:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999025:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999042:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999050:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999057:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316901.999072:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d8700 x1853163894065920/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316917 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316901.999104:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999118:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677446/12 (0 0) 00010000:00010000:0.0:1767316901.999126:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999134:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.999172:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x72:0x0], updating i_size 8192 00000080:00010000:0.0:1767316901.999336:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x72:0x0](ffff9cfe187d8908) for lock 0xd9a0da65fad56dea 00000080:00010000:0.0:1767316901.999351:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x72:0x0](ffff9cfe187d8908) 00000080:00010000:0.0:1767316901.999354:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56dea from it ffffa99f40d87b20 00010000:00010000:0.0:1767316901.999358:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999366:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316901.999400:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d204f.sanity-flr:[0x200000405:0x72:0x0](ffff9cfe187d8908), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316901.999407:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x72:0x0](ffff9cfe187d8908),name=d204f.sanity-flr 00000002:00010000:0.0:1767316901.999432:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x72:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.999441:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999451:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.999459:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xc:0x0]) in obj [0x200000bd0:0xc:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.999464:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999470:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999477:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999483:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.999498:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xc:0x0]) in obj [0x240000406:0xc:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.999504:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999511:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999517:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999523:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.999530:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316901.999535:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x72:0x0](ffff9cfe187d8908) 00000080:00010000:0.0:1767316901.999538:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x72:0x0](ffff9cfe187d8908) for lock 0xd9a0da65fad56dea 00000080:00010000:0.0:1767316901.999541:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56dea from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316901.999544:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999549:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.999559:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xc:0x0]) in obj [0x200000bd0:0xc:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.999563:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999570:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999669:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999677:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316901.999685:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xc:0x0]) in obj [0x240000406:0xc:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.999691:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999698:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999705:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316901.999816:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316901.999894:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316901.999903:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316901.999911:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.000023:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.000029:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316902.000033:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316902.000042:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56de3 00000080:00010000:0.0:1767316902.000046:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56de3 from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316902.000049:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.000055:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.000063:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.000070:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204f.sanity-flr, flags=266 00000080:00200000:0.0:1767316902.000075:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x72:0x0](ffff9cfe187d8908), inode mode 41ed mask 44 00000080:00200008:0.0:1767316902.000275:0:83725:0:(file.c:1001:ll_file_open()) START file d204f.sanity-flr:[0x200000405:0x72:0x0](ffff9cfe187d8908), flags 704400 00000002:00010000:0.0:1767316902.000295:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x72:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316902.000347:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56dff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.000355:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56dff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316902.000368:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316902.000379:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191da300 x1853163894066176/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316902.000388:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56dff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.000410:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894066176:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.000729:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.005158:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894066176:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.005193:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56dff lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.005219:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56dff lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.005226:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56dff lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.005232:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56dff lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.005239:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56dff lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.005244:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316902.005249:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56dff lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.005254:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56dff lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.005261:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56dff lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.005266:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316902.005272:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56dff lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.005277:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56dff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316902.005297:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe191da300 x1853163894066176/t8589937477(8589937477) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316902.005310:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191da300 x1853163894066176/t8589937477(8589937477) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316902.005334:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316902.005367:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x72:0x0], updating i_size 4096 00000002:00100000:0.0:1767316902.005385:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191da300 x1853163894066176/t8589937477(8589937477) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316902.005445:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d204f.sanity-flr:[0x200000405:0x72:0x0](ffff9cfe187d8908), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316902.005452:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x72:0x0](ffff9cfe187d8908),name=d204f.sanity-flr 00000002:00010000:0.0:1767316902.005472:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x72:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.005486:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.005499:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.005509:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xc:0x0]) in obj [0x200000bd0:0xc:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.005515:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.005522:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.005531:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.005539:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.005553:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xc:0x0]) in obj [0x240000406:0xc:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.005560:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.005575:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.005702:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.005711:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.005723:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316902.005729:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x72:0x0](ffff9cfe187d8908) 00000080:00010000:0.0:1767316902.005733:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x72:0x0](ffff9cfe187d8908) for lock 0xd9a0da65fad56dea 00000080:00010000:0.0:1767316902.005736:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56dea from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316902.005739:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.005745:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.005757:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xc:0x0]) in obj [0x200000bd0:0xc:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.005763:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.005770:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.005776:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.005795:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.005805:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xc:0x0]) in obj [0x240000406:0xc:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.005810:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.005818:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.005825:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.005841:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.005868:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x72:0x0](ffff9cfe187d8908) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767316902.005879:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.005900:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0xc:0x0]) in obj [0x200000bd0:0xc:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316902.005905:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.006005:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316902.007508:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894066304:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316902.007735:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.015057:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894066304:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316902.016019:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.016037:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.016192:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0xc:0x0]) in obj [0x240000406:0xc:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316902.016208:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.016242:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316902.016903:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894066432:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316902.017202:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.025634:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894066432:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316902.026359:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.026375:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.026435:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x72:0x0](ffff9cfe187d8908) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:1.0:1767316902.026455:0:83725:0:(file.c:424:ll_file_release()) START file d204f.sanity-flr:[0x200000405:0x72:0x0](ffff9cfe187d8908), flags 704000 00000002:00100000:1.0:1767316902.026519:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191da300 x1853163894066176/t8589937477(8589937477) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316902.026529:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316902.026535:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3ea00 x1853163894066688/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316902.026557:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894066688:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316902.026647:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.032563:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894066688:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316902.032714:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191da300 x1853163894066176/t8589937477(8589937477) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316902.032806:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.032826:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.032853:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.032867:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.032875:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.032881:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.032885:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56de3 00000080:00010000:1.0:1767316902.032891:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56de3 from it ffffa99f40d87c10 00010000:00010000:1.0:1767316902.032895:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.032903:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.033000:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.033011:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d204f.sanity-flr, flags=0 00000080:00200000:1.0:1767316902.033018:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.033026:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.033033:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.033041:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.033058:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.033063:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.033066:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56de3 00000080:00010000:1.0:1767316902.033070:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56de3 from it ffffa99f40d87d88 00010000:00010000:1.0:1767316902.033073:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.033233:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.033244:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316902.033250:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d204f.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316902.033275:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.033299:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.033346:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 1/0,0 mode: --/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.033353:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.033358:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316902.033361:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad56dea lrc: 0/0,0 mode: --/PR res: [0x200000405:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acf7c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.033376:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56de3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acf60 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316902.033401:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316902.033408:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3ea00 x1853163894066944/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316902.033432:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894066944:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316902.033518:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:2.0:1767316902.038237:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316902.038339:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939812608 00000100:00100000:3.0:1767316902.038351:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939812608 00000100:00100000:3.0:1767316902.038447:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10236 00000100:00100000:3.0:1767316902.038458:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939812608:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316902.038476:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316902.038565:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316902.038572:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939812608:12345-192.168.202.121@tcp:104: Request processed in 117us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316902.038652:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10236 00010000:00010000:0.0:1767316902.038723:0:49629:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316902.038731:0:49629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.038740:0:49629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037ca00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316902.038746:0:49629:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.038754:0:49629:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.038762:0:49629:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.038902:0:49629:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.038909:0:49629:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316902.038949:0:49629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.038977:0:49629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56df1 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acf8a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.038997:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.038999:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.039001:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316902.039011:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316902.039030:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894067072:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316902.044356:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:0.0:1767316902.044448:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894067072:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316902.044557:0:56325:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767316902.044573:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939812864 00000100:00100000:3.0:1767316902.044588:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939812864 00000100:00100000:3.0:1767316902.044636:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10237 00000100:00100000:3.0:1767316902.044645:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe28139c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939812864:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316902.044662:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316902.044883:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316902.044904:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe28139c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939812864:12345-192.168.202.121@tcp:104: Request processed in 259us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316902.044921:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10237 00010000:00010000:1.0:1767316902.046873:0:63296:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316902.046888:0:63296:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.046902:0:63296:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316902.046907:0:63296:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.046924:0:63296:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.046933:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.047065:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 2/0,0 mode: --/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.047072:0:63296:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316902.047114:0:63296:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 1/0,0 mode: --/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.047122:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56df8 lrc: 0/0,0 mode: --/PR res: [0x240000406:0xc:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acf98 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.047151:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316902.047153:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316902.047155:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316902.047165:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316902.047375:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894067200:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316902.058848:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894067200:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316902.063414:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894066944:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316902.063459:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x72:0x0](ffff9cfe187d8908) 00000080:00200000:1.0:1767316902.063540:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.063560:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.063625:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.063634:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.063644:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.063673:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894067328:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.063748:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.071484:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894067328:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.071511:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.071523:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.071549:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.071560:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.071573:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.071581:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.071588:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.071599:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c700 x1853163894067328/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.071612:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.071625:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316902.071632:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316902.071658:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316902.071675:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e06 00000080:00010000:1.0:1767316902.071680:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.071683:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e06 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316902.071687:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.071700:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.071726:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.071749:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d43b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316902.071753:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d43b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316902.071773:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d43b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.071814:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.071820:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.071827:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.071860:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894067456:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.072121:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.077693:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894067456:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.077720:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acffa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.077741:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acffa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.077749:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acffa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.077782:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acffa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.077792:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acffa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.077806:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acffa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.077814:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acffa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.077821:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acffa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.077840:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c700 x1853163894067456/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.077853:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acffa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.077862:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 9663677442/1 (0 0) 00000002:00010000:1.0:1767316902.077880:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000402:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.082317:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.082336:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.082347:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.082398:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894067584:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.082498:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.089424:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894067584:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.089453:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 4/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.089465:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.089477:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.089487:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.089498:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.089505:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.089511:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.089521:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3d180 x1853163894067584/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/672 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.089533:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.089563:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677442/1 (0 0) 00000080:00200000:1.0:1767316902.089593:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316902.089635:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000402:0x1:0x0](ffff9cfe0edb63c8) 00000002:00010000:1.0:1767316902.089676:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x1:0x0]) in obj [0x240000403:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.089721:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 3/1,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.089729:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 3/1,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.089739:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 3/1,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.089762:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894067712:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.089854:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.092760:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894067712:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.092787:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 4/1,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.092799:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 4/1,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.092810:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.092820:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.092842:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 5/2,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.092868:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 5/2,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.092875:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.092887:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c700 x1853163894067712/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.092902:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.094336:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677443/1 (0 0) 00010000:00010000:1.0:1767316902.094356:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.094366:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.094743:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x4:0x0]) in obj [0x200000401:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.094800:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.094807:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.094815:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.094849:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894067840:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.095403:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.099612:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894067840:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.099641:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.099656:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.099697:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.099708:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.099720:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.099727:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.099734:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.099745:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d8700 x1853163894067840/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.099759:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.099773:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935617/4 (0 0) 00010000:00010000:0.0:1767316902.099781:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.099789:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.099850:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000402:0x1:0x0], updating i_size 8192 00000080:00010000:0.0:1767316902.099869:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000402:0x1:0x0](ffff9cfe0edb63c8) for remote lock 0xd9a0da65fad56e14 00000080:00010000:0.0:1767316902.099874:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x1:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e0d 00000080:00010000:0.0:1767316902.099888:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x1:0x0](ffff9cfe0edb63c8) 00000080:00010000:0.0:1767316902.099892:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e0d from it ffffa99f40d87b20 00010000:00010000:0.0:1767316902.099895:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acffa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.099902:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acffa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767316902.100365:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad56e14 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316902.100371:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100379:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316902.100419:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d43b.sanity-flr:[0x240000402:0x1:0x0](ffff9cfe0edb63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316902.100426:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000402:0x1:0x0](ffff9cfe0edb63c8),name=d43b.sanity-flr 00000002:00010000:0.0:1767316902.100451:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.100462:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100472:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.100480:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x1:0x0]) in obj [0x240000403:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.100486:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100505:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100512:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100519:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.100527:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x4:0x0]) in obj [0x200000401:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.100533:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100540:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100547:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100554:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.100563:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316902.100568:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x1:0x0](ffff9cfe0edb63c8) 00000080:00010000:0.0:1767316902.100572:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x1:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e14 00000080:00010000:0.0:1767316902.100576:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e14 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316902.100579:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100597:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.100610:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x1:0x0]) in obj [0x240000403:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.100616:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100624:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100631:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100638:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.100646:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x4:0x0]) in obj [0x200000401:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.100651:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100658:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100723:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100729:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.100795:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316902.100804:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.100810:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100818:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.100823:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316902.100826:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316902.100840:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e06 00000080:00010000:0.0:1767316902.100844:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e06 from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316902.100846:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.100853:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.100861:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.100869:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d43b.sanity-flr, flags=266 00000080:00200000:0.0:1767316902.100875:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000402:0x1:0x0](ffff9cfe0edb63c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767316902.100883:0:83725:0:(file.c:1001:ll_file_open()) START file d43b.sanity-flr:[0x240000402:0x1:0x0](ffff9cfe0edb63c8), flags 704400 00000002:00010000:0.0:1767316902.100899:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316902.101300:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56e29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.101309:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56e29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316902.101334:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316902.101344:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8700 x1853163894068096/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316902.101353:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56e29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.101373:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894068096:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.101633:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.112146:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894068096:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.112172:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56e29 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.112252:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56e29 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.112259:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56e29 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.112265:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56e29 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.112272:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56e29 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.112277:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316902.112281:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56e29 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.112288:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56e29 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.112316:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56e29 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.112322:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316902.112329:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56e29 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.112335:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56e29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316902.112361:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe191d8700 x1853163894068096/t4294975929(4294975929) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316902.112374:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d8700 x1853163894068096/t4294975929(4294975929) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316902.112390:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316902.112421:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000402:0x1:0x0], updating i_size 4096 00000002:00100000:0.0:1767316902.112438:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d8700 x1853163894068096/t4294975929(4294975929) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316902.112500:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d43b.sanity-flr:[0x240000402:0x1:0x0](ffff9cfe0edb63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316902.112507:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000402:0x1:0x0](ffff9cfe0edb63c8),name=d43b.sanity-flr 00000002:00010000:0.0:1767316902.112528:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.112540:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.112553:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.112563:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x1:0x0]) in obj [0x240000403:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.112576:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.112657:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.112729:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.112738:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.112752:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x4:0x0]) in obj [0x200000401:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.112759:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.112767:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.112775:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.112782:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.112792:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316902.112797:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x1:0x0](ffff9cfe0edb63c8) 00000080:00010000:0.0:1767316902.112800:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x1:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e14 00000080:00010000:0.0:1767316902.112804:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e14 from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316902.112807:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.112820:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.112843:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x1:0x0]) in obj [0x240000403:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.112850:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.112858:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.112865:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.112871:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.112878:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x4:0x0]) in obj [0x200000401:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.112883:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.112889:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.112896:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.112902:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.114125:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000402:0x1:0x0](ffff9cfe0edb63c8) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767316902.114145:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.114179:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x1:0x0]) in obj [0x240000403:0x1:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316902.114199:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.114207:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316902.114909:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894068224:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316902.115569:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.127651:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894068224:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316902.128368:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.128385:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.128409:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x4:0x0]) in obj [0x200000401:0x4:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316902.128422:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.128435:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316902.129037:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894068352:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316902.129170:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.143288:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894068352:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316902.144423:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.144453:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.144616:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000402:0x1:0x0](ffff9cfe0edb63c8) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:1.0:1767316902.144645:0:83725:0:(file.c:424:ll_file_release()) START file d43b.sanity-flr:[0x240000402:0x1:0x0](ffff9cfe0edb63c8), flags 704000 00000002:00100000:1.0:1767316902.144718:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191d8700 x1853163894068096/t4294975929(4294975929) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316902.144730:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316902.144735:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f800 x1853163894068608/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316902.144758:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894068608:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316902.144863:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.152546:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894068608:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316902.152587:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191d8700 x1853163894068096/t4294975929(4294975929) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316902.152653:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.152681:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.152702:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.152716:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.152724:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.152731:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.152734:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e06 00000080:00010000:1.0:1767316902.152741:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e06 from it ffffa99f40d87c10 00010000:00010000:1.0:1767316902.152745:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.152753:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.152767:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.152777:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d43b.sanity-flr, flags=0 00000080:00200000:1.0:1767316902.152783:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.152791:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.152796:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.152820:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.152826:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.152841:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.152844:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e06 00000080:00010000:1.0:1767316902.152848:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e06 from it ffffa99f40d87d88 00010000:00010000:1.0:1767316902.152851:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.152859:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.152867:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316902.152873:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d43b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316902.152892:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655acffa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.152931:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acffa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.152939:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316902.152977:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e0d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655acffa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.152999:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.153026:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.153036:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316902.153039:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e14 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad008 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316902.153055:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316902.153062:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3ed80 x1853163894068992/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316902.153132:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3ed80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894068992:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316902.153221:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.153813:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894068736:192.168.202.121@tcp:103:rm.0 00000100:00100000:0.0:1767316902.161220:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894068736:192.168.202.121@tcp:103:rm.0 00000100:00100000:3.0:1767316902.169323:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316902.170198:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939814144 00000100:00100000:2.0:1767316902.170210:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939814144 00000100:00100000:2.0:1767316902.170312:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10238 00000100:00100000:2.0:1767316902.170322:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939814144:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316902.170340:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316902.170428:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316902.170435:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939814144:12345-192.168.202.121@tcp:104: Request processed in 116us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316902.170443:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10238 00010000:00010000:0.0:1767316902.170497:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316902.170506:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.170514:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316902.170519:0:63142:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.170528:0:63142:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.170536:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.170600:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.170624:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316902.170663:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.170671:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad56e06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655acfde expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.170694:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.170696:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.170698:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316902.170709:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316902.170727:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894069120:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316902.176838:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316902.176881:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939814912 00000100:00100000:3.0:1767316902.176891:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939814912 00000100:00100000:3.0:1767316902.176958:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10239 00000100:00100000:3.0:1767316902.176967:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939814912:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316902.176986:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316902.177070:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316902.177077:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939814912:12345-192.168.202.121@tcp:104: Request processed in 112us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316902.177119:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10239 00010000:00010000:1.0:1767316902.177486:0:63143:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316902.177494:0:63143:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.177504:0:63143:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316902.177509:0:63143:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.177517:0:63143:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.177526:0:63143:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.177630:0:63143:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 2/0,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.177637:0:63143:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316902.177670:0:63143:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 1/0,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.177677:0:63143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e1b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad016 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.177694:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316902.177696:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316902.177698:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316902.177706:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316902.177721:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894069248:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316902.180125:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894069120:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316902.181719:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894069248:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316902.183900:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316902.184143:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939815168 00000100:00100000:2.0:1767316902.184153:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939815168 00000100:00100000:2.0:1767316902.184218:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10240 00000100:00100000:2.0:1767316902.184242:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939815168:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316902.184259:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316902.184335:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316902.184342:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939815168:12345-192.168.202.121@tcp:104: Request processed in 102us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316902.184349:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10240 00010000:00010000:1.0:1767316902.184473:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316902.184481:0:59093:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.184489:0:59093:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037ca00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316902.184495:0:59093:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.184503:0:59093:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.184512:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.184630:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.184649:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316902.184673:0:59093:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.184680:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56e22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad024 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.184698:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316902.184700:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316902.184702:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316902.184718:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894069376:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316902.189300:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894069376:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316902.201448:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3ed80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894068992:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316902.201497:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000402:0x1:0x0](ffff9cfe0edb63c8) 00000080:00200000:1.0:1767316902.201595:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.201618:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.201677:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.201686:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.201695:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.201714:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894069504:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.201788:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.204463:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894069504:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.204494:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.204505:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.204518:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.204529:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.204541:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.204549:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.204556:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.204567:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3e300 x1853163894069504/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.204592:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.204605:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316902.204612:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316902.204652:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316902.204658:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e30 00000080:00010000:1.0:1767316902.204664:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.204667:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e30 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316902.204671:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.204679:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.204707:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.204724:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d44a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316902.204728:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d44a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316902.204748:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d44a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.204785:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.204792:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.204800:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.204819:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894069632:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.204908:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.209397:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894069632:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.209424:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.209447:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 4/1,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.209472:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 4/1,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.209483:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.209493:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.209506:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.209542:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.209549:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.209560:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3e300 x1853163894069632/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/688 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.209574:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.209594:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935619/15 (0 0) 00000080:00200000:1.0:1767316902.209601:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316902.209640:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000403:0xf:0x0](ffff9cfe0edb63c8) 00000080:00200000:1.0:1767316902.209650:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0xf:0x0], updating i_size 4096 00000080:00010000:1.0:1767316902.209656:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0xf:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e37 00000080:00010000:1.0:1767316902.209677:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0xf:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.209681:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e37 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316902.209684:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.209693:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316902.209735:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d44a.sanity-flr:[0x200000403:0xf:0x0](ffff9cfe0edb63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316902.209742:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000403:0xf:0x0](ffff9cfe0edb63c8),name=d44a.sanity-flr 00000002:00010000:1.0:1767316902.209763:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.209772:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.209782:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.209788:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.209793:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0xf:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.209796:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0xf:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e37 00000080:00010000:1.0:1767316902.209800:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e37 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316902.209803:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.209809:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.209869:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.209878:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.209890:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.209898:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.209903:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.209907:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.209909:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e30 00000080:00010000:1.0:1767316902.209913:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e30 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316902.209915:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.209921:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.209929:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.209935:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44a.sanity-flr, flags=266 00000080:00200000:1.0:1767316902.209941:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0xf:0x0](ffff9cfe0edb63c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767316902.209950:0:83725:0:(file.c:1001:ll_file_open()) START file d44a.sanity-flr:[0x200000403:0xf:0x0](ffff9cfe0edb63c8), flags 704400 00000002:00010000:1.0:1767316902.209965:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767316902.210015:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.210022:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316902.210032:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316902.210038:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3e300 x1853163894069888/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316902.210058:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.210121:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894069888:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.211162:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.214514:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894069888:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.214539:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e3e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.214550:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e3e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.214556:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e3e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.214562:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e3e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.214569:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e3e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.214575:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2ce00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316902.214591:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e3e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.214598:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e3e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.214603:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e3e lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.214610:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316902.214633:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e3e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.214640:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:1.0:1767316902.214661:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe18f3e300 x1853163894069888/t8589937482(8589937482) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/664 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316902.214674:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3e300 x1853163894069888/t8589937482(8589937482) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/664 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316902.214692:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316902.214721:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0xf:0x0], updating i_size 4096 00000002:00100000:1.0:1767316902.214740:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3e300 x1853163894069888/t8589937482(8589937482) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/664 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316902.214806:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d44a.sanity-flr:[0x200000403:0xf:0x0](ffff9cfe0edb63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316902.214814:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000403:0xf:0x0](ffff9cfe0edb63c8),name=d44a.sanity-flr 00000002:00010000:1.0:1767316902.214845:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.214861:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.214873:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.214880:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.214884:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0xf:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.214888:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0xf:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e37 00000080:00010000:1.0:1767316902.214893:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e37 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316902.214896:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.214910:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.214942:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000403:0xf:0x0](ffff9cfe0edb63c8) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1767316902.214957:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0xf:0x0]) in obj [0x200000403:0xf:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316902.214964:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.214972:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316902.215631:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894070016:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316902.215720:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.223961:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894070016:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316902.224776:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.224792:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316902.224864:0:83725:0:(file.c:424:ll_file_release()) START file d44a.sanity-flr:[0x200000403:0xf:0x0](ffff9cfe0edb63c8), flags 704000 00000002:00100000:1.0:1767316902.225002:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3e300 x1853163894069888/t8589937482(8589937482) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/664 e 0 to 0 dl 1767316918 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316902.225014:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316902.225020:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c000 x1853163894070272/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316902.225062:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894070272:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316902.225182:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.228265:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894070272:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316902.228303:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3e300 x1853163894069888/t8589937482(8589937482) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/664 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316902.228384:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.228404:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.228422:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.228437:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.228446:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.228452:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.228456:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e30 00000080:00010000:1.0:1767316902.228463:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e30 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316902.228466:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.228475:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.228489:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.228496:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44a.sanity-flr, flags=266 00000080:00200000:1.0:1767316902.228504:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0xf:0x0](ffff9cfe0edb63c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767316902.228526:0:83725:0:(file.c:1001:ll_file_open()) START file d44a.sanity-flr:[0x200000403:0xf:0x0](ffff9cfe0edb63c8), flags 704400 00000002:00010000:1.0:1767316902.228542:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767316902.228781:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.228790:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316902.228801:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316902.228808:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c000 x1853163894070528/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316902.228816:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.228847:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894070528:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.229032:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.232323:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894070528:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.232356:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e45 lrc: 4/1,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0be expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.232368:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e45 lrc: 4/1,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0be expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.232380:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e45 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad0be expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.232390:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e45 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0be expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.232405:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe18f3c000 x1853163894070528/t8589937484(8589937484) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/664 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316902.232435:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3c000 x1853163894070528/t8589937484(8589937484) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/664 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.232452:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e45 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0be expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.232462:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935619/15 (0 0) 00000080:00200000:1.0:1767316902.232469:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316902.232495:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0xf:0x0], updating i_size 4096 00000080:00010000:1.0:1767316902.232502:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0xf:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e45 00000080:00010000:1.0:1767316902.232509:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e45 from it ffffa99f40d87bd0 00010000:00010000:1.0:1767316902.232513:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e45 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad0be expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.232522:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e45 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0be expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.232548:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3c000 x1853163894070528/t8589937484(8589937484) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/664 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316902.232625:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d44a.sanity-flr:[0x200000403:0xf:0x0](ffff9cfe0edb63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316902.232634:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000403:0xf:0x0](ffff9cfe0edb63c8),name=d44a.sanity-flr 00000002:00010000:1.0:1767316902.232660:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.232670:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.232680:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.232695:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.232701:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0xf:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.232705:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0xf:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e37 00000080:00010000:1.0:1767316902.232709:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e37 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316902.232713:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.232719:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.232755:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000403:0xf:0x0](ffff9cfe0edb63c8) pos/size0/4096 32bit_api 0 00000080:00200000:1.0:1767316902.232778:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000403:0xf:0x0](ffff9cfe0edb63c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1767316902.232801:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0xf:0x0](ffff9cfe0edb63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.232824:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f44a.sanity-flr.mirror~2, dir=[0x200000403:0xf:0x0](ffff9cfe0edb63c8), flags=0 00000080:00200000:1.0:1767316902.232838:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f44a.sanity-flr.mirror~2, dir=[0x200000403:0xf:0x0](ffff9cfe0edb63c8), intent=getattr 00000002:00010000:1.0:1767316902.232851:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f44a.sanity-flr.mirror~2,[0x0:0x0:0x0]) in obj [0x200000403:0xf:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.232893:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 3/1,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.232899:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 3/1,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.232908:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 3/1,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.232926:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894070656:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.233003:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.236441:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894070656:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.236482:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 4/1,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.236504:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.236512:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.236525:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad0e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.236536:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.236547:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad0e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.236555:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad0e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.236562:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad0e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.236573:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3e300 x1853163894070656/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 600/1032 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.236592:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 448 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.236618:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.236631:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935619/18 (0 0) 00000080:00200000:1.0:1767316902.236638:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000403:0xf:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316902.236674:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000403:0x12:0x0](ffff9cfe0edb5348) 00000080:00200000:1.0:1767316902.236783:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000403:0x12:0x0]: layout version change: 4294967294 -> 1 00000080:00010000:1.0:1767316902.236790:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x12:0x0](ffff9cfe0edb5348) for lock 0xd9a0da65fad56e4c 00000080:00010000:1.0:1767316902.236801:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x12:0x0](ffff9cfe0edb5348) 00000080:00010000:1.0:1767316902.236804:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e4c from it ffffa99f40d87df8 00010000:00010000:1.0:1767316902.236807:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad0e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.236815:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ad0e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316902.236869:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0xf:0x0](ffff9cfe0edb63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767316902.236877:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f44a.sanity-flr.mirror~2, dir=[0x200000403:0xf:0x0](ffff9cfe0edb63c8) 00010000:00010000:1.0:1767316902.236911:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.236930:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e45 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0be expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.237002:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ad0e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316902.237013:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000403:0x12:0x0]: losing layout lock 00010000:00010000:1.0:1767316902.237052:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 1/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad0e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.237060:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 1/0,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.237065:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316902.237068:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e4c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad0e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.237117:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e37 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad0a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316902.237134:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316902.237142:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3e300 x1853163894070912/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 512/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316902.237165:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894070912:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316902.237248:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.242648:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894070912:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316902.242712:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000403:0x12:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316902.242726:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1767316902.242736:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00020000:00200000:1.0:1767316902.242741:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00020000:00200000:1.0:1767316902.242772:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[3] flags 0x10 00000080:00200000:1.0:1767316902.242808:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000403:0x12:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316902.242815:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000403:0x12:0x0](ffff9cfe0edb5348) 00000080:00200008:1.0:1767316902.242936:0:83725:0:(file.c:424:ll_file_release()) START file d44a.sanity-flr:[0x200000403:0xf:0x0](ffff9cfe0edb63c8), flags 704000 00010000:00010000:1.0:1767316902.242968:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e45 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad0be expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.243040:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.243059:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.243070:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.243124:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.243133:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.243139:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.243143:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e30 00000080:00010000:1.0:1767316902.243148:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e30 from it ffffa99f40d87c10 00010000:00010000:1.0:1767316902.243152:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.243160:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.243173:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.243725:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d44a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=0 00000080:00200000:1.0:1767316902.243731:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d44a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316902.243748:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d44a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.243800:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.243807:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.243816:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.243858:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894071040:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.244020:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.248237:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894071040:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.248265:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad119 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.248282:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 4/1,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad119 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.248289:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 4/1,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad119 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.248299:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad119 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.248312:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad119 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.248323:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad119 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.248329:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad119 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.248336:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad119 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.248347:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3d880 x1853163894071040/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/688 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.248378:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad119 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.248389:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935619/15 (0 0) 00000080:00200000:1.0:1767316902.248396:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316902.248429:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0xf:0x0], updating i_size 4096 00000080:00200000:1.0:1767316902.248432:0:83725:0:(namei.c:151:ll_iget()) got inode: [0x200000403:0xf:0x0](ffff9cfe0edb63c8): rc = 0 00000080:00010000:1.0:1767316902.248439:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0xf:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e53 00000080:00010000:1.0:1767316902.248451:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0xf:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.248455:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e53 from it ffffa99f40d87e00 00010000:00010000:1.0:1767316902.248458:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad119 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.248466:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad119 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.248504:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.248524:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.248533:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.248544:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.248550:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.248556:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.248559:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e30 00000080:00010000:1.0:1767316902.248562:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e30 from it ffffa99f40d87d88 00010000:00010000:1.0:1767316902.248576:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.248595:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.248604:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316902.248614:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d44a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316902.248635:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.248661:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad119 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.248674:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e45 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad0be expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.248719:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3c000 x1853163894070528/t8589937484(8589937484) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/664 e 0 to 0 dl 1767316918 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316902.248730:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316902.248737:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3d880 x1853163894071296/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316902.248761:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894071296:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316902.248855:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.252193:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894071296:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316902.252233:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3c000 x1853163894070528/t8589937484(8589937484) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/664 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767316902.252333:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 1/0,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad119 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.252343:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e45 lrc: 1/0,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad0be expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.252350:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.252356:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767316902.252359:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e53 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad119 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.252370:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e45 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad0be expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.252381:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad086 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316902.252395:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316902.252401:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3d880 x1853163894071552/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316902.252421:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894071552:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316902.252488:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.256576:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894071552:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316902.256642:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000403:0xf:0x0](ffff9cfe0edb63c8) 00000080:00200000:1.0:1767316902.256733:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.256774:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.256849:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.256858:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.256869:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.256889:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894071680:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.256975:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.261942:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894071680:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.261966:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.261978:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.261989:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.261998:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.262010:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.262017:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.262042:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.262054:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c000 x1853163894071680/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.262066:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.262133:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316902.262140:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316902.262170:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316902.262177:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e5a 00000080:00010000:1.0:1767316902.262193:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.262196:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e5a from it ffffa99f40d87b58 00010000:00010000:1.0:1767316902.262200:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.262209:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.262235:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.262251:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d44a.sanity-flr-1, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316902.262255:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d44a.sanity-flr-1, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316902.262277:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d44a.sanity-flr-1,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.262317:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.262337:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.262347:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.262366:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894071808:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.262445:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.269864:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894071808:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.269890:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad158 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.269921:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad158 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.269929:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad158 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.269940:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad158 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.269949:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad158 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.269961:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad158 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.269968:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad158 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.269990:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad158 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.270000:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c000 x1853163894071808/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/584 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.270012:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad158 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.270022:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 9663677442/4 (0 0) 00000002:00010000:1.0:1767316902.270039:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000402:0x4:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.270115:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.270122:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.270130:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.270147:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894071936:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.270223:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.272412:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894071936:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.272437:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 4/1,0 mode: --/CR res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.272448:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.272478:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.272488:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.272501:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.272508:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.272514:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.272525:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c380 x1853163894071936/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.272538:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.272551:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677442/4 (0 0) 00000080:00200000:1.0:1767316902.272575:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316902.272684:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000402:0x4:0x0](ffff9cfe0edb63c8) 00000080:00200000:1.0:1767316902.272697:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000402:0x4:0x0], updating i_size 4096 00000080:00010000:1.0:1767316902.272704:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000402:0x4:0x0](ffff9cfe0edb63c8) for remote lock 0xd9a0da65fad56e68 00000080:00010000:1.0:1767316902.272710:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x4:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e61 00000080:00010000:1.0:1767316902.272721:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x4:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.272730:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e61 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316902.272734:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad158 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.272743:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad158 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767316902.272757:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad56e68 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316902.272760:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.272767:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316902.272799:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d44a.sanity-flr-1:[0x240000402:0x4:0x0](ffff9cfe0edb63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316902.272806:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000402:0x4:0x0](ffff9cfe0edb63c8),name=d44a.sanity-flr-1 00000002:00010000:1.0:1767316902.273455:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x4:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.273467:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.273479:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.273487:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.273493:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x4:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.273496:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x4:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e68 00000080:00010000:1.0:1767316902.273501:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e68 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316902.273504:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.273523:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.273658:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.273679:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.273688:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.273696:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.273703:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.273707:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.273710:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e5a 00000080:00010000:1.0:1767316902.273714:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e5a from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316902.273716:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.273723:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.273733:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.273739:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44a.sanity-flr-1, flags=266 00000080:00200000:1.0:1767316902.273745:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000402:0x4:0x0](ffff9cfe0edb63c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767316902.273754:0:83725:0:(file.c:1001:ll_file_open()) START file d44a.sanity-flr-1:[0x240000402:0x4:0x0](ffff9cfe0edb63c8), flags 704400 00000002:00010000:1.0:1767316902.273769:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x4:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767316902.273824:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.273848:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316902.273860:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316902.273869:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c380 x1853163894072192/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316902.273878:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.273900:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894072192:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.274576:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.279876:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894072192:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.279902:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e6f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.280060:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e6f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.280069:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e6f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.280076:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e6f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.280105:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e6f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.280111:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2cc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316902.280115:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e6f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.280139:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e6f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.280147:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e6f lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.280154:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316902.280164:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e6f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.280171:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:1.0:1767316902.280325:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe18f3c380 x1853163894072192/t4294975932(4294975932) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/664 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316902.280338:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3c380 x1853163894072192/t4294975932(4294975932) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/664 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316902.280355:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316902.280384:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000402:0x4:0x0], updating i_size 4096 00000002:00100000:1.0:1767316902.280405:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3c380 x1853163894072192/t4294975932(4294975932) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/664 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316902.280470:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d44a.sanity-flr-1:[0x240000402:0x4:0x0](ffff9cfe0edb63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316902.280479:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000402:0x4:0x0](ffff9cfe0edb63c8),name=d44a.sanity-flr-1 00000002:00010000:1.0:1767316902.280499:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x4:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.280513:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.280525:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.280542:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.280548:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x4:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.280551:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x4:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e68 00000080:00010000:1.0:1767316902.280556:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e68 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316902.280560:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.280567:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.280676:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000402:0x4:0x0](ffff9cfe0edb63c8) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1767316902.280692:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x4:0x0]) in obj [0x240000402:0x4:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316902.280698:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.280706:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316902.281795:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894072320:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316902.281905:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.289476:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894072320:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316902.290177:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.290204:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.290272:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000402:0x4:0x0](ffff9cfe0edb63c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200008:1.0:1767316902.290291:0:83725:0:(file.c:424:ll_file_release()) START file d44a.sanity-flr-1:[0x240000402:0x4:0x0](ffff9cfe0edb63c8), flags 704000 00000002:00100000:1.0:1767316902.290351:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3c380 x1853163894072192/t4294975932(4294975932) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/664 e 0 to 0 dl 1767316918 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316902.290363:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316902.290369:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c000 x1853163894072576/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316902.290391:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894072576:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316902.290478:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.294455:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894072576:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316902.294499:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3c380 x1853163894072192/t4294975932(4294975932) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/664 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316902.294567:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.294599:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.294623:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.294637:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.294644:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.294650:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.294653:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e5a 00000080:00010000:1.0:1767316902.294661:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e5a from it ffffa99f40d87c10 00010000:00010000:1.0:1767316902.294679:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.294688:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.294704:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.294716:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44a.sanity-flr-1, flags=0 00000080:00200000:1.0:1767316902.294722:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.294729:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.294735:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.294743:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.294748:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.294752:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.294754:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e5a 00000080:00010000:1.0:1767316902.294757:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e5a from it ffffa99f40d87d88 00010000:00010000:1.0:1767316902.294760:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.294767:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.294773:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316902.294778:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d44a.sanity-flr-1, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316902.294799:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad158 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.294865:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad158 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.294872:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316902.294907:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e61 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad158 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316902.294935:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316902.294955:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894072704:192.168.202.121@tcp:103:rm.0 00010000:00010000:1.0:1767316902.295056:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.295192:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.295199:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316902.295201:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e68 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad166 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316902.295220:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316902.295227:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c380 x1853163894072960/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316902.295243:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894072960:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316902.295271:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.299440:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894072704:192.168.202.121@tcp:103:rm.0 00000100:00100000:2.0:1767316902.301672:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316902.302134:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939816448 00000100:00100000:3.0:1767316902.302147:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939816448 00000100:00100000:3.0:1767316902.302213:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10241 00000100:00100000:3.0:1767316902.302223:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939816448:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316902.302239:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316902.302328:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316902.302334:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939816448:12345-192.168.202.121@tcp:104: Request processed in 114us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316902.302362:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10241 00010000:00010000:0.0:1767316902.302519:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316902.302528:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.302537:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2ca00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316902.302542:0:42049:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.302551:0:42049:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.302560:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.302643:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.302651:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316902.302679:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.302687:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad56e5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad13c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.302707:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.302709:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.302710:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316902.302718:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316902.302733:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894073088:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316902.308918:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894073088:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316902.318043:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894072960:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316902.318160:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000402:0x4:0x0](ffff9cfe0edb63c8) 00000080:00200000:1.0:1767316902.318237:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.318260:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.318323:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.318333:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.318343:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.318365:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894073216:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.318451:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.321791:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894073216:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.321819:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.321840:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.321852:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.321862:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.321875:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.321902:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.321908:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.321931:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c000 x1853163894073216/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.321951:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.321966:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316902.321972:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316902.322002:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316902.322009:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e76 00000080:00010000:1.0:1767316902.322015:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.322018:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e76 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316902.322021:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.322029:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.322061:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.322108:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d44b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316902.322113:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d44b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316902.322136:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d44b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.322187:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.322194:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.322204:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.322222:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894073344:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.322318:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.328249:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894073344:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.328277:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.328298:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.328306:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.328316:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.328327:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.328338:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.328345:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.328366:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.328377:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c000 x1853163894073344/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.328389:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.328399:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935619/20 (0 0) 00000080:00200000:1.0:1767316902.328406:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316902.328440:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000403:0x14:0x0](ffff9cfe0edb63c8) 00000080:00200000:1.0:1767316902.328448:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0x14:0x0], updating i_size 4096 00000080:00010000:1.0:1767316902.328455:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x14:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e7d 00000080:00010000:1.0:1767316902.328468:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x14:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.328471:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e7d from it ffffa99f40d87b20 00010000:00010000:1.0:1767316902.328474:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.328483:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316902.328524:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d44b.sanity-flr:[0x200000403:0x14:0x0](ffff9cfe0edb63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316902.328531:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000403:0x14:0x0](ffff9cfe0edb63c8),name=d44b.sanity-flr 00000002:00010000:1.0:1767316902.328554:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0x14:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.328563:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.328596:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.328604:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.328608:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x14:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.328612:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x14:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e7d 00000080:00010000:1.0:1767316902.328616:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e7d from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316902.328619:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.328626:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.328681:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.328689:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.328697:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.328705:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.328711:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.328715:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.328718:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e76 00000080:00010000:1.0:1767316902.328721:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e76 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316902.328724:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.328742:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.328752:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.328760:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44b.sanity-flr, flags=266 00000080:00200000:1.0:1767316902.328766:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0x14:0x0](ffff9cfe0edb63c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767316902.328775:0:83725:0:(file.c:1001:ll_file_open()) START file d44b.sanity-flr:[0x200000403:0x14:0x0](ffff9cfe0edb63c8), flags 704400 00000002:00010000:1.0:1767316902.328792:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0x14:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767316902.328851:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.328859:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316902.328870:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316902.328878:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c000 x1853163894073600/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316902.328886:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.328908:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894073600:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.329147:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.333777:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894073600:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.333806:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e84 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.333819:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e84 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.333855:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e84 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.333862:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e84 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.333869:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e84 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.333875:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2cc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316902.333879:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e84 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.333885:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e84 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.333893:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e84 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.333899:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316902.333917:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e84 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.333923:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:1.0:1767316902.333952:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe18f3c000 x1853163894073600/t8589937489(8589937489) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316902.333965:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3c000 x1853163894073600/t8589937489(8589937489) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316902.333978:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316902.334010:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0x14:0x0], updating i_size 4096 00000002:00100000:1.0:1767316902.334032:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3c000 x1853163894073600/t8589937489(8589937489) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316902.334340:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d44b.sanity-flr:[0x200000403:0x14:0x0](ffff9cfe0edb63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316902.334349:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000403:0x14:0x0](ffff9cfe0edb63c8),name=d44b.sanity-flr 00000002:00010000:1.0:1767316902.334373:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0x14:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.334389:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.334400:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.334408:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.334413:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x14:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.334416:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x14:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e7d 00000080:00010000:1.0:1767316902.334421:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e7d from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316902.334424:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.334431:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.334464:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000403:0x14:0x0](ffff9cfe0edb63c8) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1767316902.334477:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0x14:0x0]) in obj [0x200000403:0x14:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316902.334484:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.334492:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316902.335844:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894073728:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316902.336173:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.345871:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894073728:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316902.346551:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.346567:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316902.346647:0:83725:0:(file.c:424:ll_file_release()) START file d44b.sanity-flr:[0x200000403:0x14:0x0](ffff9cfe0edb63c8), flags 704000 00000002:00100000:1.0:1767316902.346720:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3c000 x1853163894073600/t8589937489(8589937489) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316918 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316902.346732:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316902.346737:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f800 x1853163894073984/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316902.346761:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894073984:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316902.347422:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.350453:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894073984:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316902.350489:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3c000 x1853163894073600/t8589937489(8589937489) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316902.350571:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.350602:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.350619:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.350652:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.350660:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.350665:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.350669:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e76 00000080:00010000:1.0:1767316902.350677:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e76 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316902.350681:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.350689:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.350704:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.350712:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44b.sanity-flr, flags=266 00000080:00200000:1.0:1767316902.350718:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0x14:0x0](ffff9cfe0edb63c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767316902.350727:0:83725:0:(file.c:1001:ll_file_open()) START file d44b.sanity-flr:[0x200000403:0x14:0x0](ffff9cfe0edb63c8), flags 704400 00000002:00010000:1.0:1767316902.350743:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0x14:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767316902.350788:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.350795:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316902.350805:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316902.350812:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f800 x1853163894074240/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316902.350820:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.350859:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894074240:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.351041:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.354386:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894074240:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.354421:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e8b lrc: 4/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1eb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.354431:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e8b lrc: 4/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1eb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.354443:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e8b lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1eb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.354453:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e8b lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1eb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.354467:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe18f3f800 x1853163894074240/t8589937491(8589937491) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316902.354480:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f800 x1853163894074240/t8589937491(8589937491) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.354491:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e8b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1eb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.354500:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935619/20 (0 0) 00000080:00200000:1.0:1767316902.354506:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316902.354526:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0x14:0x0], updating i_size 4096 00000080:00010000:1.0:1767316902.354531:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x14:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e8b 00000080:00010000:1.0:1767316902.354570:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e8b from it ffffa99f40d87bd0 00010000:00010000:1.0:1767316902.354575:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e8b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1eb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.354590:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e8b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1eb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.354624:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f800 x1853163894074240/t8589937491(8589937491) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316902.354707:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d44b.sanity-flr:[0x200000403:0x14:0x0](ffff9cfe0edb63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316902.354716:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000403:0x14:0x0](ffff9cfe0edb63c8),name=d44b.sanity-flr 00000002:00010000:1.0:1767316902.354742:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0x14:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.354752:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.354764:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.354771:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.354776:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x14:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.354779:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x14:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56e7d 00000080:00010000:1.0:1767316902.354783:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e7d from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316902.354786:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.354792:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.354840:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000403:0x14:0x0](ffff9cfe0edb63c8) pos/size0/4096 32bit_api 0 00000080:00200000:1.0:1767316902.354872:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000403:0x14:0x0](ffff9cfe0edb63c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1767316902.354901:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0x14:0x0](ffff9cfe0edb63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.354917:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f44b.sanity-flr.mirror~1, dir=[0x200000403:0x14:0x0](ffff9cfe0edb63c8), flags=0 00000080:00200000:1.0:1767316902.354920:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f44b.sanity-flr.mirror~1, dir=[0x200000403:0x14:0x0](ffff9cfe0edb63c8), intent=getattr 00000002:00010000:1.0:1767316902.354934:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f44b.sanity-flr.mirror~1,[0x0:0x0:0x0]) in obj [0x200000403:0x14:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.354992:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.354999:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.355007:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.355026:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894074368:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.355142:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.359162:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894074368:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.359190:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 4/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad20e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.359212:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad20e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.359220:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad20e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.359232:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad20e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.359277:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad20e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.359289:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad20e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.359296:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad20e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.359302:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad20e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.359312:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c000 x1853163894074368/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 600/720 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.359323:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad20e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.359335:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad20e expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.359345:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935619/24 (0 0) 00000080:00200000:1.0:1767316902.359352:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000403:0x14:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316902.359383:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000403:0x18:0x0](ffff9cfe0edb5348) 00000080:00200000:1.0:1767316902.359471:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000403:0x18:0x0]: layout version change: 4294967294 -> 1 00000080:00010000:1.0:1767316902.359478:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x18:0x0](ffff9cfe0edb5348) for lock 0xd9a0da65fad56e92 00000080:00010000:1.0:1767316902.359487:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x18:0x0](ffff9cfe0edb5348) 00000080:00010000:1.0:1767316902.359490:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e92 from it ffffa99f40d87df8 00010000:00010000:1.0:1767316902.359499:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad20e expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.359508:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ad20e expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316902.359541:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0x14:0x0](ffff9cfe0edb63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767316902.359549:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f44b.sanity-flr.mirror~1, dir=[0x200000403:0x14:0x0](ffff9cfe0edb63c8) 00010000:00010000:1.0:1767316902.359592:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.359610:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e8b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1eb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.359684:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ad20e expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316902.359696:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000403:0x18:0x0]: losing layout lock 00010000:00010000:1.0:1767316902.359726:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad20e expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.359733:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 1/0,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.359738:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316902.359741:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56e92 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad20e expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.359754:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56e7d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad1cf expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316902.359783:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316902.359790:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c000 x1853163894074624/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 512/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316902.359814:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894074624:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316902.360057:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.366123:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894074624:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316902.366405:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000403:0x18:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316902.366419:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316902.366447:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000403:0x18:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316902.366455:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000403:0x18:0x0](ffff9cfe0edb5348) 00000080:00200000:1.0:1767316902.366539:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0x14:0x0](ffff9cfe0edb63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.366557:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f44b.sanity-flr, dir=[0x200000403:0x14:0x0](ffff9cfe0edb63c8), flags=0 00000080:00200000:1.0:1767316902.366562:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f44b.sanity-flr, dir=[0x200000403:0x14:0x0](ffff9cfe0edb63c8), intent=getattr 00000002:00010000:1.0:1767316902.366665:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f44b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000403:0x14:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.366732:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.366743:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.366753:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.366773:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894074752:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.366931:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.372301:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894074752:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.372347:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 4/1,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad246 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.372450:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad246 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.372460:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad246 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.372472:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad246 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.372483:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad246 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.372505:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad246 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.372513:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad246 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.372520:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad246 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.372530:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3d180 x1853163894074752/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/720 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.372541:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad246 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.372554:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad246 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316902.372564:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935619/21 (0 0) 00000080:00200000:0.0:1767316902.372570:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000403:0x14:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316902.372681:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000403:0x15:0x0](ffff9cfe187dcb08) 00000080:00200000:0.0:1767316902.372760:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000403:0x15:0x0]: layout version change: 4294967294 -> 5 00000080:00010000:0.0:1767316902.372766:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x15:0x0](ffff9cfe187dcb08) for lock 0xd9a0da65fad56e99 00000080:00010000:0.0:1767316902.372775:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x15:0x0](ffff9cfe187dcb08) 00000080:00010000:0.0:1767316902.372779:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e99 from it ffffa99f40d87df8 00010000:00010000:0.0:1767316902.372782:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad246 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316902.372800:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ad246 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316902.372868:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0x14:0x0](ffff9cfe0edb63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767316902.372876:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f44b.sanity-flr, dir=[0x200000403:0x14:0x0](ffff9cfe0edb63c8) 00010000:00010000:0.0:1767316902.373151:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ad246 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316902.373169:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000403:0x15:0x0]: losing layout lock 00010000:00010000:0.0:1767316902.373316:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad246 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316902.373323:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316902.373326:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad56e99 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad246 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767316902.373352:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316902.373360:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191dad80 x1853163894075008/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316902.373383:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894075008:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316902.374076:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.384411:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894075008:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316902.384479:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000403:0x15:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316902.384492:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316902.384517:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000403:0x15:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316902.384525:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000403:0x15:0x0](ffff9cfe187dcb08) 00000080:00200008:1.0:1767316902.384678:0:83725:0:(file.c:424:ll_file_release()) START file d44b.sanity-flr:[0x200000403:0x14:0x0](ffff9cfe0edb63c8), flags 704000 00010000:00010000:1.0:1767316902.384707:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e8b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1eb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.384755:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.384778:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.384791:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.384800:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.384807:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.384814:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.384817:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e76 00000080:00010000:1.0:1767316902.384825:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e76 from it ffffa99f40d87c10 00010000:00010000:1.0:1767316902.384840:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.384849:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.384884:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.384903:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d44b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=0 00000080:00200000:1.0:1767316902.384907:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d44b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316902.384922:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d44b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.385691:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.385705:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.385716:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.385743:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894075136:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.385922:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.390286:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894075136:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.390314:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad27e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.390333:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad27e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.390342:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad27e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.390354:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad27e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.390382:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad27e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.390394:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad27e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.390402:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad27e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.390409:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad27e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.390419:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3c700 x1853163894075136/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.390432:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad27e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.390441:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935619/20 (0 0) 00000080:00200000:1.0:1767316902.390448:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316902.390469:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0x14:0x0], updating i_size 4096 00000080:00200000:1.0:1767316902.390472:0:83725:0:(namei.c:151:ll_iget()) got inode: [0x200000403:0x14:0x0](ffff9cfe0edb63c8): rc = 0 00000080:00010000:1.0:1767316902.390477:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x14:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56ea0 00000080:00010000:1.0:1767316902.390487:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x14:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.390490:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ea0 from it ffffa99f40d87e00 00010000:00010000:1.0:1767316902.390493:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad27e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.390510:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad27e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.390539:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.390556:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.390563:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.390573:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.390647:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.390652:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.390655:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56e76 00000080:00010000:1.0:1767316902.390659:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56e76 from it ffffa99f40d87d88 00010000:00010000:1.0:1767316902.390662:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.390669:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.390677:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316902.390684:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d44b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316902.390703:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.390724:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad27e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.390745:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e8b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad1eb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.390780:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3f800 x1853163894074240/t8589937491(8589937491) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316918 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316902.390791:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316902.390796:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c700 x1853163894075392/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316902.390814:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894075392:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316902.391015:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.394858:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894075392:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316902.394895:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3f800 x1853163894074240/t8589937491(8589937491) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767316902.395146:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad27e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.395157:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e8b lrc: 1/0,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad1eb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.395164:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.395170:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767316902.395174:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ea0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad27e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.395207:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56e8b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x14:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad1eb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.395218:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56e76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad1b3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316902.395240:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316902.395247:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3c700 x1853163894075648/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316902.395269:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894075648:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316902.395391:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.400401:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894075648:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316902.400448:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000403:0x14:0x0](ffff9cfe0edb63c8) 00000080:00200000:1.0:1767316902.400518:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.400540:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.400670:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.400680:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.400689:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.400710:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894075776:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.400850:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.406737:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894075776:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.406782:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.406795:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.406808:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.406820:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.406842:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.406849:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.406856:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.406867:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3f800 x1853163894075776/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.406880:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.406895:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316902.406903:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316902.406941:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316902.406964:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ea7 00000080:00010000:1.0:1767316902.406969:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.406972:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ea7 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316902.406975:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.406982:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.407010:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.407032:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d44d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316902.407036:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d44d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316902.407061:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d44d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.407169:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.407176:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.407187:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.407209:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894075904:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.407302:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.412647:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894075904:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.412676:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.412702:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 4/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.412726:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 4/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.412738:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.412751:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.412765:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.412772:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.412779:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.412789:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3f800 x1853163894075904/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.412801:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.412811:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 9663677442/6 (0 0) 00000002:00010000:1.0:1767316902.412834:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000402:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.412887:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.412904:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.412915:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.412936:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894076032:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.413030:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.416406:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894076032:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.416436:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 4/1,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.416449:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.416460:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.416471:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.416482:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.416488:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.416495:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.416528:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3f100 x1853163894076032/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/584 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.416541:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.416554:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677442/6 (0 0) 00000080:00200000:1.0:1767316902.416900:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316902.416935:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000402:0x6:0x0](ffff9cfe0edb63c8) 00000080:00200000:1.0:1767316902.416942:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000402:0x6:0x0], updating i_size 4096 00000080:00010000:1.0:1767316902.416950:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000402:0x6:0x0](ffff9cfe0edb63c8) for remote lock 0xd9a0da65fad56eb5 00000080:00010000:1.0:1767316902.416955:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x6:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56eae 00000080:00010000:1.0:1767316902.416965:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x6:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.416968:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56eae from it ffffa99f40d87b20 00010000:00010000:1.0:1767316902.416972:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.416981:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767316902.416994:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad56eb5 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316902.416997:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.417003:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316902.417036:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d44d.sanity-flr:[0x240000402:0x6:0x0](ffff9cfe0edb63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316902.417049:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000402:0x6:0x0](ffff9cfe0edb63c8),name=d44d.sanity-flr 00000002:00010000:1.0:1767316902.417073:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x6:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.417107:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.417117:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.417124:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.417129:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x6:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.417131:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x6:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56eb5 00000080:00010000:1.0:1767316902.417136:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56eb5 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316902.417138:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.417145:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.417286:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.417296:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.417304:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.417313:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.417318:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.417323:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.417325:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ea7 00000080:00010000:1.0:1767316902.417335:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ea7 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316902.417338:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.417345:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.417353:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.417362:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44d.sanity-flr, flags=266 00000080:00200000:1.0:1767316902.417367:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000402:0x6:0x0](ffff9cfe0edb63c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767316902.417376:0:83725:0:(file.c:1001:ll_file_open()) START file d44d.sanity-flr:[0x240000402:0x6:0x0](ffff9cfe0edb63c8), flags 704400 00000002:00010000:1.0:1767316902.417391:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x6:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767316902.417437:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ebc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.417445:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ebc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316902.417456:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316902.417465:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f100 x1853163894076288/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316902.417475:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ebc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.417496:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894076288:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.418439:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.422308:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894076288:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.422333:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ebc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.422364:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ebc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.422370:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ebc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.422376:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ebc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.422384:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ebc lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.422390:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316902.422395:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ebc lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.422402:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ebc lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.422408:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ebc lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.422414:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316902.422422:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ebc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.422428:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ebc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:1.0:1767316902.422454:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe18f3f100 x1853163894076288/t4294975935(4294975935) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316902.422467:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f100 x1853163894076288/t4294975935(4294975935) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316902.422490:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316902.422510:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000402:0x6:0x0], updating i_size 4096 00000002:00100000:1.0:1767316902.422530:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f100 x1853163894076288/t4294975935(4294975935) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316902.422662:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d44d.sanity-flr:[0x240000402:0x6:0x0](ffff9cfe0edb63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316902.422670:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000402:0x6:0x0](ffff9cfe0edb63c8),name=d44d.sanity-flr 00000002:00010000:1.0:1767316902.422692:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x6:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.422703:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.422715:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.422722:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.422727:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x6:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.422731:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x6:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56eb5 00000080:00010000:1.0:1767316902.422736:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56eb5 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316902.422740:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.422748:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.422777:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000402:0x6:0x0](ffff9cfe0edb63c8) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1767316902.422789:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x6:0x0]) in obj [0x240000402:0x6:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316902.422794:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.422814:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316902.423745:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894076416:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316902.423862:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.431523:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894076416:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316902.432465:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.432484:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.432549:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000402:0x6:0x0](ffff9cfe0edb63c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200008:1.0:1767316902.432573:0:83725:0:(file.c:424:ll_file_release()) START file d44d.sanity-flr:[0x240000402:0x6:0x0](ffff9cfe0edb63c8), flags 704000 00000002:00100000:1.0:1767316902.432742:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3f100 x1853163894076288/t4294975935(4294975935) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316918 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316902.432756:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316902.432761:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f800 x1853163894076672/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316902.432786:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894076672:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316902.433058:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.435441:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894076672:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316902.435477:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3f100 x1853163894076288/t4294975935(4294975935) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316902.435588:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.435608:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.435624:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.435637:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.435646:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.435652:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.435655:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ea7 00000080:00010000:1.0:1767316902.435662:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ea7 from it ffffa99f40d87c10 00010000:00010000:1.0:1767316902.435666:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.435674:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.435687:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.435697:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44d.sanity-flr, flags=0 00000080:00200000:1.0:1767316902.435703:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.435707:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.435712:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.435719:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.435735:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.435738:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.435741:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ea7 00000080:00010000:1.0:1767316902.435744:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ea7 from it ffffa99f40d87d88 00010000:00010000:1.0:1767316902.435747:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.435754:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.435761:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316902.435767:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d44d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316902.435784:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad2bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.435821:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 1/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad2bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.435838:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316902.435873:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eae lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad2bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316902.435904:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316902.435938:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894076800:192.168.202.121@tcp:103:rm.0 00010000:00010000:1.0:1767316902.436383:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.436475:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.436488:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316902.436491:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56eb5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad2cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316902.436512:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316902.436520:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f100 x1853163894077056/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316902.436536:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894077056:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316902.442824:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894076800:192.168.202.121@tcp:103:rm.0 00000100:00100000:1.0:1767316902.442873:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:2.0:1767316902.446695:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316902.446797:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939817984 00000100:00100000:3.0:1767316902.446807:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939817984 00000100:00100000:3.0:1767316902.446904:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10242 00000100:00100000:3.0:1767316902.446923:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939817984:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316902.446943:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316902.447022:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316902.447029:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939817984:12345-192.168.202.121@tcp:104: Request processed in 109us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316902.447037:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10242 00010000:00010000:0.0:1767316902.447107:0:63840:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316902.447115:0:63840:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.447123:0:63840:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316902.447128:0:63840:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.447151:0:63840:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.447159:0:63840:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.447228:0:63840:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.447236:0:63840:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316902.447262:0:63840:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.447269:0:63840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ea7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad2a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.447290:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.447292:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.447294:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316902.447303:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316902.447320:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894077184:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316902.450598:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894077184:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316902.457621:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894077056:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316902.457674:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000402:0x6:0x0](ffff9cfe0edb63c8) 00000080:00200000:1.0:1767316902.457765:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.457789:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.457863:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.457873:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.457883:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.457903:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894077312:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.458004:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.462642:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894077312:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.462685:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.462697:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.462707:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.462718:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.462728:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.462736:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.462743:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.462755:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3f800 x1853163894077312/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.462768:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.462782:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316902.462788:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316902.462816:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316902.462837:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ec3 00000080:00010000:1.0:1767316902.462843:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.462846:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ec3 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316902.462850:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.462859:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.462885:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.462908:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d44e.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316902.462913:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d44e.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316902.462936:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d44e.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.462973:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.462980:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.462988:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.463007:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894077440:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.463139:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.467642:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894077440:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.467668:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.467690:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.467711:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.467723:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.467734:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.467746:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 5/2,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.467754:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 5/2,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.467761:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.467772:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3f800 x1853163894077440/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/672 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.467786:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.467797:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935620/1 (0 0) 00000080:00200000:1.0:1767316902.467804:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316902.467852:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000404:0x1:0x0](ffff9cfe0edb63c8) 00000002:00010000:1.0:1767316902.467889:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x7:0x0]) in obj [0x200000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.467952:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.467967:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.467978:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.468001:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894077568:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.468127:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.471194:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894077568:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.471217:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 4/1,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.471228:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.471238:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.471248:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.471260:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.471267:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.471275:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.471304:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3d180 x1853163894077568/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.471318:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.471330:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935616/7 (0 0) 00010000:00010000:1.0:1767316902.471338:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.471346:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.471378:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x7:0x0]) in obj [0x240000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.471424:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.471432:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.471440:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.471460:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894077696:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.471536:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.475484:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894077696:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.475509:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 4/1,0 mode: --/CR res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475541:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475553:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475564:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475587:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475596:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475604:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.475616:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3d180 x1853163894077696/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.475630:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475643:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677440/7 (0 0) 00010000:00010000:1.0:1767316902.475651:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475658:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.475701:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000404:0x1:0x0], updating i_size 8192 00000080:00010000:1.0:1767316902.475711:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000404:0x1:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56eca 00000080:00010000:1.0:1767316902.475725:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000404:0x1:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.475728:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56eca from it ffffa99f40d87b20 00010000:00010000:1.0:1767316902.475732:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475740:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316902.475773:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d44e.sanity-flr:[0x200000404:0x1:0x0](ffff9cfe0edb63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316902.475780:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000404:0x1:0x0](ffff9cfe0edb63c8),name=d44e.sanity-flr 00000002:00010000:1.0:1767316902.475804:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000404:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.475814:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 2/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475824:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 2/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.475843:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x7:0x0]) in obj [0x200000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.475850:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475857:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475864:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475879:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.475888:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x7:0x0]) in obj [0x240000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.475893:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475901:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475920:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475927:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.475936:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316902.475941:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000404:0x1:0x0](ffff9cfe0edb63c8) 00000080:00010000:1.0:1767316902.475944:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000404:0x1:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56eca 00000080:00010000:1.0:1767316902.475948:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56eca from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316902.475950:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475957:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.475968:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x7:0x0]) in obj [0x200000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.475973:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475985:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475993:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.475999:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.476007:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x7:0x0]) in obj [0x240000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.476011:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.476017:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.476022:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.476028:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.476135:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.476145:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.476152:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.476160:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.476176:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.476494:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.476499:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ec3 00000080:00010000:1.0:1767316902.476504:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ec3 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316902.476508:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.476515:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.476524:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.476531:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44e.sanity-flr, flags=266 00000080:00200000:0.0:1767316902.476676:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000404:0x1:0x0](ffff9cfe0edb63c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767316902.476688:0:83725:0:(file.c:1001:ll_file_open()) START file d44e.sanity-flr:[0x200000404:0x1:0x0](ffff9cfe0edb63c8), flags 704400 00000002:00010000:0.0:1767316902.476706:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000404:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316902.476756:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56edf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.476772:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56edf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316902.476784:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316902.476793:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191db100 x1853163894077952/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316902.476802:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56edf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.476821:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894077952:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.476997:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.480683:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894077952:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.480706:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56edf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.480719:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56edf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.480726:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56edf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.480733:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56edf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.480740:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56edf lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.480746:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316902.480751:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56edf lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.480773:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56edf lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.480779:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56edf lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.480786:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316902.480792:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56edf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.480799:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56edf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316902.480817:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe191db100 x1853163894077952/t8589937497(8589937497) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316902.480842:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191db100 x1853163894077952/t8589937497(8589937497) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316902.480863:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316902.480899:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000404:0x1:0x0], updating i_size 4096 00000002:00100000:0.0:1767316902.481015:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191db100 x1853163894077952/t8589937497(8589937497) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316902.481195:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d44e.sanity-flr:[0x200000404:0x1:0x0](ffff9cfe0edb63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316902.481203:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000404:0x1:0x0](ffff9cfe0edb63c8),name=d44e.sanity-flr 00000002:00010000:0.0:1767316902.481225:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000404:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.481239:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 2/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.481253:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 2/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.481272:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x7:0x0]) in obj [0x200000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.481279:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.481286:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.481294:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.481301:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.481315:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x7:0x0]) in obj [0x240000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.481321:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.481329:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.481335:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.481341:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.481350:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316902.481356:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000404:0x1:0x0](ffff9cfe0edb63c8) 00000080:00010000:0.0:1767316902.481359:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000404:0x1:0x0](ffff9cfe0edb63c8) for lock 0xd9a0da65fad56eca 00000080:00010000:0.0:1767316902.481369:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56eca from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316902.481373:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.481379:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.481393:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x7:0x0]) in obj [0x200000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.481399:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.481406:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.481412:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.481417:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.481424:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x7:0x0]) in obj [0x240000400:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.481428:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.481434:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.481440:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.481456:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.481483:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000404:0x1:0x0](ffff9cfe0edb63c8) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767316902.481495:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.481516:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x7:0x0]) in obj [0x200000400:0x7:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316902.481522:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.481531:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316902.482557:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894078080:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316902.482664:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.490656:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894078080:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316902.491437:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.491456:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.491484:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x7:0x0]) in obj [0x240000400:0x7:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316902.491501:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.491533:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316902.492310:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894078208:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316902.492484:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.499112:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894078208:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316902.499732:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.499748:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.499806:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000404:0x1:0x0](ffff9cfe0edb63c8) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:0.0:1767316902.499843:0:83725:0:(file.c:424:ll_file_release()) START file d44e.sanity-flr:[0x200000404:0x1:0x0](ffff9cfe0edb63c8), flags 704000 00000002:00100000:0.0:1767316902.499916:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191db100 x1853163894077952/t8589937497(8589937497) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316902.499930:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316902.499935:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8380 x1853163894078464/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316902.499960:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894078464:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316902.500052:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.505174:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894078464:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316902.505213:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191db100 x1853163894077952/t8589937497(8589937497) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316902.505303:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316902.505321:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.505341:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.505354:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.505362:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316902.505368:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316902.505372:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ec3 00000080:00010000:0.0:1767316902.505378:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ec3 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316902.505382:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.505390:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.505404:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.505414:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d44e.sanity-flr, flags=0 00000080:00200000:0.0:1767316902.505420:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316902.505427:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.505433:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.505440:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.505459:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316902.505463:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316902.505466:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ec3 00000080:00010000:0.0:1767316902.505470:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ec3 from it ffffa99f40d87d88 00010000:00010000:0.0:1767316902.505473:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.505480:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.505489:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316902.505494:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d44e.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316902.505516:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.505542:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.505594:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 1/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.505602:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.505608:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316902.505611:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56eca lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad334 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.505625:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ec3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad318 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316902.505649:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316902.505656:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8380 x1853163894078720/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316902.505678:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894078720:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316902.505764:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316902.509421:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316902.509514:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939819648 00000100:00100000:3.0:1767316902.509525:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939819648 00000100:00100000:3.0:1767316902.509588:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10243 00000100:00100000:3.0:1767316902.509598:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15468:x1853163939819648:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316902.509617:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316902.509734:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316902.509741:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15468:x1853163939819648:12345-192.168.202.121@tcp:104: Request processed in 145us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316902.509749:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10243 00010000:00010000:0.0:1767316902.511031:0:42048:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316902.511043:0:42048:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.511054:0:42048:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316902.511059:0:42048:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.511066:0:42048:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.511074:0:42048:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.511352:0:42048:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.511359:0:42048:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316902.511388:0:42048:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 1/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.511395:0:42048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56ed1 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad342 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.511423:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.511424:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.511426:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316902.511476:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894078848:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316902.516736:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316902.516850:0:42040:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767316902.516869:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939819904 00000100:00100000:3.0:1767316902.516877:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939819904 00000100:00100000:3.0:1767316902.516960:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10244 00000100:00100000:3.0:1767316902.516969:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2813b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:16197:x1853163939819904:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316902.516988:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316902.517065:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316902.517072:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2813b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:16197:x1853163939819904:12345-192.168.202.121@tcp:104: Request processed in 104us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316902.517103:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10244 00010000:00010000:0.0:1767316902.517201:0:49629:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316902.517208:0:49629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.517216:0:49629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316902.517221:0:49629:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.517229:0:49629:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.517237:0:49629:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.517343:0:49629:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.517351:0:49629:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316902.517371:0:49629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.517379:0:49629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56ed8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad350 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.517397:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.517399:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.517409:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316902.519700:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894078848:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316902.519731:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316902.519744:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894078976:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316902.528494:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894078976:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316902.537734:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894078720:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316902.537783:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000404:0x1:0x0](ffff9cfe0edb63c8) 00000080:00200000:0.0:1767316902.537883:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316902.537905:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.537977:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.537989:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.538000:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.538021:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894079104:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.538191:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.541190:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894079104:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.541224:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.541250:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.541262:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.541273:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.541289:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.541318:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.541326:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.541338:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191da680 x1853163894079104/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.541353:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.541365:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316902.541373:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316902.541404:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316902.541411:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ee6 00000080:00010000:0.0:1767316902.541420:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316902.541423:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ee6 from it ffffa99f40d87b58 00010000:00010000:0.0:1767316902.541425:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.541443:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.541467:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.541483:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d45.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316902.541486:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d45.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316902.541507:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d45.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.541557:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.541562:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.541569:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.541589:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894079232:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.541861:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.546289:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894079232:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.546321:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3b2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.546344:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3b2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.546352:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3b2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.546364:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3b2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.546374:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3b2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.546385:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3b2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.546393:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3b2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.546415:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3b2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.546503:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191da680 x1853163894079232/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.546520:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3b2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.546532:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 9663677445/1 (0 0) 00000002:00010000:0.0:1767316902.546551:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000405:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.546602:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.546610:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.546619:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.546708:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894079360:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.546785:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.554607:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894079360:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.554633:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.554645:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.554676:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.554686:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.554697:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.554702:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.554707:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.554715:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d8000 x1853163894079360/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/672 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.554729:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.554743:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/1 (0 0) 00000080:00200000:0.0:1767316902.554763:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316902.554806:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448) 00000002:00010000:0.0:1767316902.554849:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.554895:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.554901:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.554922:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.554942:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894079488:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.555017:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.558618:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894079488:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.558644:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 4/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.558656:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 4/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.558667:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.558678:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.558690:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 5/2,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.558698:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 5/2,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.558705:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.558727:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191da680 x1853163894079488/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.558757:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.558770:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677443/2 (0 0) 00010000:00010000:0.0:1767316902.558777:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.558784:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.558811:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.558871:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.558878:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.558887:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.558918:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894079616:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.559061:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.564885:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894079616:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.564915:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.564928:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.564961:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.564972:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.564985:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.564993:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.565000:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.565011:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191da680 x1853163894079616/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.565024:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.565036:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935617/5 (0 0) 00010000:00010000:0.0:1767316902.565045:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.565054:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.565370:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x1:0x0], updating i_size 8192 00000080:00010000:0.0:1767316902.565392:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000405:0x1:0x0](ffff9cfe187df448) for remote lock 0xd9a0da65fad56ef4 00000080:00010000:0.0:1767316902.565398:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x1:0x0](ffff9cfe187df448) for lock 0xd9a0da65fad56eed 00000080:00010000:0.0:1767316902.565410:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x1:0x0](ffff9cfe187df448) 00000080:00010000:0.0:1767316902.565413:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56eed from it ffffa99f40d87b20 00010000:00010000:0.0:1767316902.565417:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3b2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.565425:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3b2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767316902.565434:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad56ef4 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316902.565437:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.565444:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316902.565475:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d45.sanity-flr:[0x240000405:0x1:0x0](ffff9cfe187df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316902.565482:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448),name=d45.sanity-flr 00000002:00010000:0.0:1767316902.565507:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.565516:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.565527:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.565536:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.565540:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.565558:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.565566:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.565572:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.566356:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.566364:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.566374:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.566382:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.566388:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.566398:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316902.566403:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x1:0x0](ffff9cfe187df448) 00000080:00010000:0.0:1767316902.566406:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x1:0x0](ffff9cfe187df448) for lock 0xd9a0da65fad56ef4 00000080:00010000:0.0:1767316902.566410:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ef4 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316902.566413:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.566435:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.566449:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.566456:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.566463:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.566471:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.566477:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.566484:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.566488:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.566494:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.566501:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.566506:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.566568:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316902.566657:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.566665:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.566673:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.566679:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316902.566683:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316902.566686:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ee6 00000080:00010000:0.0:1767316902.566690:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ee6 from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316902.566692:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.566698:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.566707:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.566714:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d45.sanity-flr, flags=266 00000080:00200000:0.0:1767316902.566719:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448), inode mode 41ed mask 44 00000080:00200008:0.0:1767316902.566726:0:83725:0:(file.c:1001:ll_file_open()) START file d45.sanity-flr:[0x240000405:0x1:0x0](ffff9cfe187df448), flags 704400 00000002:00010000:0.0:1767316902.566742:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316902.566794:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.566800:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316902.566822:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316902.566845:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8000 x1853163894079872/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316902.566854:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.566878:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894079872:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.567055:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.572999:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894079872:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.573022:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f09 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.573036:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f09 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.573044:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f09 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.573052:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f09 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.573059:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f09 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.573066:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037d200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316902.573071:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f09 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.573236:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f09 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.573264:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f09 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.573271:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316902.573278:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f09 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.573285:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316902.573313:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe191d8000 x1853163894079872/t4294975940(4294975940) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316902.573327:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d8000 x1853163894079872/t4294975940(4294975940) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316902.573345:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316902.573665:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x1:0x0], updating i_size 4096 00000002:00100000:1.0:1767316902.573689:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d8000 x1853163894079872/t4294975940(4294975940) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316902.573751:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d45.sanity-flr:[0x240000405:0x1:0x0](ffff9cfe187df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316902.573759:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448),name=d45.sanity-flr 00000002:00010000:1.0:1767316902.573780:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.573793:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.573811:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.573822:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.573838:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.573846:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.573854:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.573862:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.573874:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.573880:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.573888:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.573895:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.573902:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.574014:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316902.574020:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x1:0x0](ffff9cfe187df448) 00000080:00010000:1.0:1767316902.574024:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x1:0x0](ffff9cfe187df448) for lock 0xd9a0da65fad56ef4 00000080:00010000:1.0:1767316902.574028:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ef4 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316902.574031:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.574038:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.574049:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.574054:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.574061:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.574067:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.574073:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.574307:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.574314:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.574322:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.574336:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.574344:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.574372:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767316902.574385:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.574403:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316902.574407:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.574412:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316902.575384:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894080000:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316902.575530:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.585874:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894080000:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316902.588845:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.588866:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.588892:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316902.588933:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.588948:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316902.590358:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894080128:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316902.590775:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.608179:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894080128:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316902.608855:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.608871:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316902.608943:0:83725:0:(file.c:424:ll_file_release()) START file d45.sanity-flr:[0x240000405:0x1:0x0](ffff9cfe187df448), flags 704000 00000002:00100000:1.0:1767316902.609008:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191d8000 x1853163894079872/t4294975940(4294975940) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316902.609021:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316902.609027:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f800 x1853163894080384/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316902.609052:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894080384:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316902.609968:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.619385:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894080384:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316902.619439:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191d8000 x1853163894079872/t4294975940(4294975940) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316902.619550:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316902.619570:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.619588:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.619603:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.619611:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316902.619616:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316902.619620:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ee6 00000080:00010000:1.0:1767316902.619639:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ee6 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316902.619643:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.619651:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.619666:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.619673:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d45.sanity-flr, flags=266 00000080:00200000:1.0:1767316902.619682:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448), inode mode 41ed mask 44 00000080:00200008:1.0:1767316902.619690:0:83725:0:(file.c:1001:ll_file_open()) START file d45.sanity-flr:[0x240000405:0x1:0x0](ffff9cfe187df448), flags 704400 00000002:00010000:1.0:1767316902.619706:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767316902.619763:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.619771:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316902.619795:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316902.619801:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f800 x1853163894080640/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316902.619810:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.619841:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894080640:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.620779:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.636683:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894080640:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.636806:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f10 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.636819:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f10 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.636840:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f10 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.636851:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f10 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.636868:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe18f3f800 x1853163894080640/t4294975942(4294975942) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316902.636881:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f800 x1853163894080640/t4294975942(4294975942) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.636897:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f10 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637485:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 16 res 9663677445/1 (0 0) 00000080:00200000:1.0:1767316902.637492:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316902.637530:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316902.637537:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x1:0x0](ffff9cfe187df448) for lock 0xd9a0da65fad56f10 00000080:00010000:1.0:1767316902.637547:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f10 from it ffffa99f40d87bd0 00010000:00010000:1.0:1767316902.637552:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f10 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637561:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f10 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.637602:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18f3f800 x1853163894080640/t4294975942(4294975942) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316902.637673:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d45.sanity-flr:[0x240000405:0x1:0x0](ffff9cfe187df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316902.637681:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448),name=d45.sanity-flr 00000002:00010000:1.0:1767316902.637705:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.637726:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637738:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.637748:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.637754:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637761:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637776:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637783:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.637793:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.637800:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637807:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637814:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637820:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.637839:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316902.637844:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x1:0x0](ffff9cfe187df448) 00000080:00010000:1.0:1767316902.637847:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x1:0x0](ffff9cfe187df448) for lock 0xd9a0da65fad56ef4 00000080:00010000:1.0:1767316902.637851:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ef4 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316902.637854:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637860:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.637884:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.637890:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637897:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637904:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637921:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.637929:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.637934:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637942:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637948:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.637954:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.637991:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767316902.638004:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.638035:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x2:0x0]) in obj [0x240000403:0x2:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316902.638042:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.638049:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767316902.638062:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767316902.638065:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.638072:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.638107:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x5:0x0]) in obj [0x200000401:0x5:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316902.638114:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.638122:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767316902.638132:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767316902.638136:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.638142:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.638179:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:1.0:1767316902.638211:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.638226:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f45.sanity-flr.copy, dir=[0x240000405:0x1:0x0](ffff9cfe187df448), flags=0 00000080:00200000:1.0:1767316902.638230:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f45.sanity-flr.copy, dir=[0x240000405:0x1:0x0](ffff9cfe187df448), intent=getattr 00000002:00010000:1.0:1767316902.638246:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f45.sanity-flr.copy,[0x0:0x0:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.638290:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.638297:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.638306:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.638329:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894080768:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.638441:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.649651:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894080768:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.649680:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 4/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad41b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.649704:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad41b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.649722:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad41b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.649733:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad41b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.649743:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad41b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.649771:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad41b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.649779:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad41b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.649786:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad41b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.649797:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18f3d180 x1853163894080768/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/1624 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.649808:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 1040 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad41b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.649822:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad41b expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.649842:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/4 (0 0) 00000080:00200000:1.0:1767316902.649849:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000403:0x2:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316902.649883:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000405:0x4:0x0](ffff9cfe0ed980c8) 00000080:00200000:1.0:1767316902.650013:0:83725:0:(file.c:6809:ll_layout_conf()) [0x240000405:0x4:0x0]: layout version change: 4294967294 -> 9 00000080:00010000:1.0:1767316902.650020:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x4:0x0](ffff9cfe0ed980c8) for lock 0xd9a0da65fad56f17 00000080:00010000:1.0:1767316902.650030:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x4:0x0](ffff9cfe0ed980c8) 00000080:00010000:1.0:1767316902.650033:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f17 from it ffffa99f40d87df8 00010000:00010000:1.0:1767316902.650037:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad41b expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.650319:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ad41b expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316902.650354:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448), inode mode 41ed mask 3 00000080:00200000:1.0:1767316902.650360:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f45.sanity-flr.copy, dir=[0x240000405:0x1:0x0](ffff9cfe187df448) 00010000:00010000:1.0:1767316902.650392:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.650464:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ad41b expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316902.650476:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x240000405:0x4:0x0]: losing layout lock 00010000:00010000:1.0:1767316902.650508:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad41b expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.650513:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 1/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.650516:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316902.650518:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f17 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad41b expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.650530:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56efb lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad3ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316902.650547:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316902.650554:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3d180 x1853163894081024/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316902.651541:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894081024:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316902.651677:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.675266:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894081024:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316902.675327:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x240000405:0x4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316902.675339:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000405:0x4:0x0]: flr state: 1, move mirror from 3 to 3, have retried: 0, mirror count: 4 00020000:00200000:1.0:1767316902.675342:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316902.675348:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[7] flags 0x16 00020000:00200000:1.0:1767316902.675363:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[8] flags 0x6 00000080:00200000:1.0:1767316902.675383:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x240000405:0x4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316902.675390:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000405:0x4:0x0](ffff9cfe0ed980c8) 00000080:00200000:1.0:1767316902.675794:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.675813:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=template, dir=[0x240000405:0x1:0x0](ffff9cfe187df448), flags=0 00000080:00200000:1.0:1767316902.675817:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=template, dir=[0x240000405:0x1:0x0](ffff9cfe187df448), intent=getattr 00000002:00010000:1.0:1767316902.675872:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: template,[0x0:0x0:0x0]) in obj [0x240000403:0x2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.676019:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.676029:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.676039:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.676189:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894081152:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.676364:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.682318:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894081152:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.682346:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 4/1,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad453 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.682391:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 4/1,0 mode: --/PR res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad453 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.682400:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 4/1,0 mode: --/PR res: [0x240000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad453 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.682411:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad453 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.682422:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad453 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.682434:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad453 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.682442:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad453 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.682449:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad453 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.682461:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558f480 x1853163894081152/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/640 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.682473:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad453 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.682486:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad453 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.682523:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/2 (0 0) 00000080:00200000:1.0:1767316902.682531:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000403:0x2:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316902.682565:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000405:0x2:0x0](ffff9cfe0ed980c8) 00000080:00200000:1.0:1767316902.682649:0:83725:0:(file.c:6809:ll_layout_conf()) [0x240000405:0x2:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1767316902.682655:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x2:0x0](ffff9cfe0ed980c8) for lock 0xd9a0da65fad56f1e 00000080:00010000:1.0:1767316902.682667:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x2:0x0](ffff9cfe0ed980c8) 00000080:00010000:1.0:1767316902.682670:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f1e from it ffffa99f40d87df8 00010000:00010000:1.0:1767316902.682673:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad453 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.682682:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ad453 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316902.682719:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448), inode mode 41ed mask 3 00000080:00200000:1.0:1767316902.682728:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=template, dir=[0x240000405:0x1:0x0](ffff9cfe187df448) 00010000:00010000:1.0:1767316902.682760:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ad453 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316902.682775:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x240000405:0x2:0x0]: losing layout lock 00010000:00010000:1.0:1767316902.682811:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 1/0,0 mode: --/PR res: [0x240000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad453 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.682817:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316902.682820:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f1e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad453 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767316902.682853:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316902.682860:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558f480 x1853163894081408/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316902.682889:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894081408:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316902.682986:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.689704:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894081408:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316902.689765:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x240000405:0x2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316902.689779:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316902.689805:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x240000405:0x2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316902.689813:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000405:0x2:0x0](ffff9cfe0ed980c8) 00000080:00200000:1.0:1767316902.689900:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.689917:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f45.sanity-flr, dir=[0x240000405:0x1:0x0](ffff9cfe187df448), flags=0 00000080:00200000:1.0:1767316902.689922:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f45.sanity-flr, dir=[0x240000405:0x1:0x0](ffff9cfe187df448), intent=getattr 00000002:00010000:1.0:1767316902.689947:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f45.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000401:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.689999:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.690009:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.690018:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.690039:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ed80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894081536:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.690325:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.696499:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ed80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894081536:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.696526:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad48b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.697210:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad48b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.697233:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad48b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.697244:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad48b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.697254:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad48b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.697266:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad48b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.697273:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad48b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.697281:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad48b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.697295:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558ed80 x1853163894081536/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/1624 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316902.697307:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 1040 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad48b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.697319:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad48b expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.697329:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/2 (0 0) 00000080:00200000:1.0:1767316902.697337:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000401:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316902.697379:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x2:0x0](ffff9cfe0ed980c8) 00000080:00200000:1.0:1767316902.697688:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x2:0x0]: layout version change: 4294967294 -> 9 00000080:00010000:1.0:1767316902.697696:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x2:0x0](ffff9cfe0ed980c8) for lock 0xd9a0da65fad56f25 00000080:00010000:1.0:1767316902.697707:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x2:0x0](ffff9cfe0ed980c8) 00000080:00010000:1.0:1767316902.697711:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f25 from it ffffa99f40d87df8 00010000:00010000:1.0:1767316902.697715:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad48b expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.697724:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ad48b expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316902.697765:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448), inode mode 41ed mask 3 00000080:00200000:1.0:1767316902.697774:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f45.sanity-flr, dir=[0x240000405:0x1:0x0](ffff9cfe187df448) 00010000:00010000:1.0:1767316902.697808:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.701023:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ad48b expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316902.701545:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x2:0x0]: losing layout lock 00010000:00010000:0.0:1767316902.701596:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad48b expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316902.701605:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.701611:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316902.701614:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56f25 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad48b expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316902.701633:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad3dc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316902.701671:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316902.701684:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191da680 x1853163894081792/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316902.701709:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894081792:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316902.701811:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.706957:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894081792:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316902.707019:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316902.707032:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x2:0x0]: flr state: 1, move mirror from 3 to 3, have retried: 0, mirror count: 4 00020000:00200000:0.0:1767316902.707036:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316902.707042:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[7] flags 0x16 00020000:00200000:0.0:1767316902.707059:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[8] flags 0x6 00000080:00200000:0.0:1767316902.707129:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316902.707138:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x2:0x0](ffff9cfe0ed980c8) 00000080:00200008:0.0:1767316902.707269:0:83725:0:(file.c:424:ll_file_release()) START file d45.sanity-flr:[0x240000405:0x1:0x0](ffff9cfe187df448), flags 704000 00010000:00010000:0.0:1767316902.707298:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f10 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad3f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.707339:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316902.707355:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.707365:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.707374:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.707381:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316902.707399:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316902.707403:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ee6 00000080:00010000:0.0:1767316902.707411:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ee6 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316902.707414:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.707422:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.707647:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.707658:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d45.sanity-flr, flags=0 00000080:00200000:0.0:1767316902.707664:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316902.707673:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.707680:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.707688:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.707694:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316902.707698:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316902.707701:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56ee6 00000080:00010000:0.0:1767316902.707704:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ee6 from it ffffa99f40d87d88 00010000:00010000:0.0:1767316902.707708:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.707714:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.707723:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316902.707734:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d45.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316902.707757:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad3b2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.707799:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 1/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad3b2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.707806:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767316902.707885:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894081920:192.168.202.121@tcp:103:rm.0 00010000:00010000:0.0:1767316902.708213:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56eed lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad3b2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.708243:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f10 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad3f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.708282:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3f800 x1853163894080640/t4294975942(4294975942) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316902.708294:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316902.708299:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8000 x1853163894082176/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316902.708315:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894082176:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316902.708359:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.712902:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894082176:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316902.712953:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3f800 x1853163894080640/t4294975942(4294975942) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767316902.713004:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.713043:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f10 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad3f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.713064:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.713070:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316902.713074:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f10 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad3f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.713116:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56ef4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad3c0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316902.713138:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316902.713145:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8000 x1853163894082432/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316902.713170:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894082432:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316902.713241:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.714666:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894081920:192.168.202.121@tcp:103:rm.0 00000100:00100000:3.0:1767316902.717395:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316902.717738:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939821184 00000100:00100000:2.0:1767316902.717749:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939821184 00000100:00100000:2.0:1767316902.717847:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10245 00000100:00100000:2.0:1767316902.717857:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:16197:x1853163939821184:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316902.717874:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316902.717965:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316902.717971:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:16197:x1853163939821184:12345-192.168.202.121@tcp:104: Request processed in 116us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316902.717978:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10245 00010000:00010000:1.0:1767316902.718036:0:63296:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316902.718044:0:63296:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.718057:0:63296:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316902.718062:0:63296:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.718071:0:63296:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.718126:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.718193:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.718200:0:63296:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316902.718221:0:63296:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.718228:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56ee6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad396 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.718247:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316902.718249:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316902.718251:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316902.718258:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316902.718273:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894082560:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316902.729234:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894082560:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316902.739379:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894082432:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316902.739416:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000405:0x1:0x0](ffff9cfe187df448) 00000080:00200000:0.0:1767316902.739492:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316902.739516:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.739579:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.739588:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.739598:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.739635:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894082688:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.739722:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.743655:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894082688:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.743682:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.743694:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.743705:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.743715:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.743726:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.743733:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.743740:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.743752:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d9500 x1853163894082688/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.743763:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.743792:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316902.743799:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316902.743838:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316902.743845:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56f2c 00000080:00010000:0.0:1767316902.743852:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316902.743855:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f2c from it ffffa99f40d87b58 00010000:00010000:0.0:1767316902.743858:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.743866:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.743891:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.744046:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d46.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316902.744051:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d46.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316902.744074:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d46.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.744402:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.744410:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.744419:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.744440:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894082816:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.744585:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.748344:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894082816:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.748383:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.748403:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.748411:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.748422:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.748432:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.748443:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.748451:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.748457:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.748467:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d9500 x1853163894082816/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/672 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.748480:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.748490:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/3 (0 0) 00000080:00200000:0.0:1767316902.748504:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316902.748541:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448) 00000002:00010000:0.0:1767316902.748571:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.748701:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.748709:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.748717:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.748738:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894082944:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.748873:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.751781:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894082944:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.751804:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 4/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.751815:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 4/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.751835:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.751845:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.751857:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.751881:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.751889:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.751900:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191db100 x1853163894082944/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.751996:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.752009:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935616/8 (0 0) 00010000:00010000:0.0:1767316902.752016:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.752023:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.752050:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.752165:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.752173:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.752271:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.752291:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894083072:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.752393:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.754845:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894083072:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.754868:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 4/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.754879:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.754889:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.754898:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755006:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755016:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755022:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.755034:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191db100 x1853163894083072/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.755046:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755057:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677440/8 (0 0) 00010000:00010000:0.0:1767316902.755167:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755175:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.755423:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x3:0x0], updating i_size 8192 00000080:00010000:0.0:1767316902.755434:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x3:0x0](ffff9cfe187df448) for lock 0xd9a0da65fad56f33 00000080:00010000:0.0:1767316902.755446:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x3:0x0](ffff9cfe187df448) 00000080:00010000:0.0:1767316902.755450:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f33 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316902.755454:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755462:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316902.755490:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d46.sanity-flr:[0x200000405:0x3:0x0](ffff9cfe187df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316902.755497:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448),name=d46.sanity-flr 00000002:00010000:0.0:1767316902.755521:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x3:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.755531:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755541:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.755550:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.755556:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755649:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755659:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755667:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.755678:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.755684:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755691:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755697:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755703:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.755712:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316902.755717:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x3:0x0](ffff9cfe187df448) 00000080:00010000:0.0:1767316902.755720:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x3:0x0](ffff9cfe187df448) for lock 0xd9a0da65fad56f33 00000080:00010000:0.0:1767316902.755724:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f33 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316902.755727:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755744:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.755757:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.755762:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755770:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755778:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755785:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.755792:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.755796:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755803:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755810:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.755817:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.755896:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316902.756001:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.756009:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.756017:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.756024:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316902.756028:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316902.756031:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56f2c 00000080:00010000:0.0:1767316902.756035:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f2c from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316902.756038:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.756044:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.756052:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.756059:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d46.sanity-flr, flags=266 00000080:00200000:0.0:1767316902.756064:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448), inode mode 41ed mask 44 00000080:00200008:0.0:1767316902.756072:0:83725:0:(file.c:1001:ll_file_open()) START file d46.sanity-flr:[0x200000405:0x3:0x0](ffff9cfe187df448), flags 704400 00000002:00010000:0.0:1767316902.756170:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x3:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316902.756316:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.756323:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316902.756347:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316902.756357:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9500 x1853163894083328/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316902.756366:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.756386:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894083328:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.756682:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.760651:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894083328:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.760675:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f48 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.760688:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f48 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.760695:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f48 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.760702:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f48 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.760708:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f48 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.760714:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037de00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316902.760719:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f48 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.760725:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f48 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.760750:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f48 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.760756:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316902.760763:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f48 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.760769:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316902.760788:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe191d9500 x1853163894083328/t8589937503(8589937503) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316902.760800:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d9500 x1853163894083328/t8589937503(8589937503) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316902.760815:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316902.760860:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x3:0x0], updating i_size 4096 00000002:00100000:0.0:1767316902.760879:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d9500 x1853163894083328/t8589937503(8589937503) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316902.761031:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d46.sanity-flr:[0x200000405:0x3:0x0](ffff9cfe187df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316902.761039:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448),name=d46.sanity-flr 00000002:00010000:0.0:1767316902.761060:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x3:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.761173:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.761201:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.761214:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.761225:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.761232:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.761240:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.761246:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.761260:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.761267:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.761274:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.761281:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.761287:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.761297:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316902.761303:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x3:0x0](ffff9cfe187df448) 00000080:00010000:0.0:1767316902.761306:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x3:0x0](ffff9cfe187df448) for lock 0xd9a0da65fad56f33 00000080:00010000:0.0:1767316902.761310:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f33 from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316902.761313:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.761326:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.761339:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.761345:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.761352:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.761359:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.761366:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.761373:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.761378:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.761384:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.761392:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.761398:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.761438:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767316902.761449:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.761471:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316902.761477:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.761485:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316902.762519:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894083456:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316902.762821:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.769744:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894083456:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316902.770460:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.770477:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.770499:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316902.770515:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.770527:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316902.771155:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894083584:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316902.771254:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.779675:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894083584:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316902.780421:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.780438:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316902.780509:0:83725:0:(file.c:424:ll_file_release()) START file d46.sanity-flr:[0x200000405:0x3:0x0](ffff9cfe187df448), flags 704000 00000002:00100000:0.0:1767316902.780699:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191d9500 x1853163894083328/t8589937503(8589937503) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316902.780710:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316902.780716:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191db100 x1853163894083840/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316902.780738:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894083840:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316902.780891:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.785362:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894083840:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316902.785399:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191d9500 x1853163894083328/t8589937503(8589937503) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316902.785479:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316902.785500:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.785517:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.785544:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.785554:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316902.785559:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316902.785563:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56f2c 00000080:00010000:0.0:1767316902.785569:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f2c from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316902.785584:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.785593:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.785608:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.785615:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d46.sanity-flr, flags=266 00000080:00200000:0.0:1767316902.785623:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448), inode mode 41ed mask 44 00000080:00200008:0.0:1767316902.785632:0:83725:0:(file.c:1001:ll_file_open()) START file d46.sanity-flr:[0x200000405:0x3:0x0](ffff9cfe187df448), flags 704400 00000002:00010000:0.0:1767316902.785649:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x3:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1767316902.785697:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.785705:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316902.785717:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316902.785723:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191db100 x1853163894084096/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316902.785733:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.785761:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894084096:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.785939:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.789394:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894084096:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.789429:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f4f lrc: 4/1,0 mode: --/CR res: [0x200000405:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad54f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789440:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f4f lrc: 4/1,0 mode: --/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad54f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789452:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f4f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad54f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789461:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f4f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad54f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.789475:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe191db100 x1853163894084096/t8589937505(8589937505) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316902.789488:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191db100 x1853163894084096/t8589937505(8589937505) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.789503:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f4f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad54f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789513:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/3 (0 0) 00000080:00200000:0.0:1767316902.789519:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316902.789561:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x3:0x0], updating i_size 4096 00000080:00010000:0.0:1767316902.789569:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x3:0x0](ffff9cfe187df448) for lock 0xd9a0da65fad56f4f 00000080:00010000:0.0:1767316902.789598:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f4f from it ffffa99f40d87bd0 00010000:00010000:0.0:1767316902.789602:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f4f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad54f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789611:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f4f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad54f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.789635:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191db100 x1853163894084096/t8589937505(8589937505) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316902.789695:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d46.sanity-flr:[0x200000405:0x3:0x0](ffff9cfe187df448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316902.789703:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448),name=d46.sanity-flr 00000002:00010000:0.0:1767316902.789722:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x3:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.789732:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789742:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.789753:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.789758:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789766:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789773:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789779:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.789796:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.789803:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789811:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789818:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789841:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.789850:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316902.789857:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x3:0x0](ffff9cfe187df448) 00000080:00010000:0.0:1767316902.789860:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x3:0x0](ffff9cfe187df448) for lock 0xd9a0da65fad56f33 00000080:00010000:0.0:1767316902.789865:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f33 from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316902.789868:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789875:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.789886:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.789891:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789899:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789911:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789918:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.789925:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.789930:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789937:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789943:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.789950:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.789978:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767316902.789988:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.790007:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316902.790012:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.790019:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767316902.790038:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767316902.790042:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.790049:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.790058:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316902.790063:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.790071:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767316902.790105:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767316902.790109:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.790116:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.790151:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:0.0:1767316902.790171:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.790185:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=dir.copy, dir=[0x200000405:0x3:0x0](ffff9cfe187df448), flags=0 00000080:00200000:0.0:1767316902.790189:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=dir.copy, dir=[0x200000405:0x3:0x0](ffff9cfe187df448), intent=getattr 00000002:00010000:0.0:1767316902.790200:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: dir.copy,[0x0:0x0:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.790237:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.790251:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.790260:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.790279:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894084224:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.790351:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.794452:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894084224:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.794478:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 4/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.794500:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.794507:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.794519:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.794530:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.794541:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.794548:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.794572:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.794594:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d9500 x1853163894084224/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/672 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.794607:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.794616:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/8 (0 0) 00000080:00200000:0.0:1767316902.794623:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000400:0x8:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316902.794661:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x8:0x0](ffff9cfe187ddb88) 00000002:00010000:0.0:1767316902.794697:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0xa:0x0]) in obj [0x200000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.794746:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 3/1,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.794754:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 3/1,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.794763:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 3/1,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.794784:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894084352:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.794874:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.798543:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894084352:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.798567:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 4/1,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.798590:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 4/1,0 mode: --/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.798617:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 4/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.798627:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 4/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.798639:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 5/2,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.798647:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 5/2,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.798654:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 4/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.798664:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d8700 x1853163894084352/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.798678:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.798691:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935616/10 (0 0) 00010000:00010000:0.0:1767316902.798699:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.798706:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.798732:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0xa:0x0]) in obj [0x240000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.798788:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.798794:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.798803:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.798821:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894084480:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.798904:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.802246:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894084480:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.802273:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 4/1,0 mode: --/CR res: [0x240000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.802285:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.802295:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.802307:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.802317:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.802325:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.802332:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.802357:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d8700 x1853163894084480/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.802372:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.802385:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677440/10 (0 0) 00010000:00010000:0.0:1767316902.802393:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.802400:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.802434:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8:0x0], updating i_size 8192 00000080:00010000:0.0:1767316902.802444:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56f56 00000080:00010000:0.0:1767316902.802456:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8:0x0](ffff9cfe187ddb88) 00000080:00010000:0.0:1767316902.802460:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f56 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316902.802464:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.802471:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316902.802499:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file dir.copy:[0x200000405:0x8:0x0](ffff9cfe187ddb88), request_mask 2047, flags 0, foreign 0 00000002:00010000:0.0:1767316902.802541:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316902.802551:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.802740:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767316902.802758:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767316902.802762:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.802769:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.802781:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316902.802787:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.802796:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767316902.802805:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767316902.802808:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.802816:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.803843:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8:0x0](ffff9cfe187ddb88),name=dir.copy 00000002:00010000:0.0:1767316902.803870:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.803881:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.804032:0:83726:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316902.804042:0:83726:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.804050:0:83726:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767316902.804062:0:83726:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767316902.804071:0:83726:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.804109:0:83726:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.804127:0:83726:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x8:0x0]) in obj [0x240000400:0x8:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316902.804134:0:83726:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.804142:0:83726:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767316902.804151:0:83726:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767316902.804153:0:83726:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.804159:0:83726:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.804239:0:83726:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83726 initiator: MDT0 00010000:00010000:1.0:1767316902.804246:0:83726:0:(ldlm_request.c:1177:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83726 initiator: MDT0 00010000:00010000:1.0:1767316902.804272:0:83726:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83726 initiator: MDT0 00010000:00010000:1.0:1767316902.804277:0:83726:0:(ldlm_request.c:1177:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83726 initiator: MDT0 00000100:00100000:1.0:1767316902.804368:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894084608:192.168.202.121@tcp:63:ll_sa.0 00000100:00100000:1.0:1767316902.804505:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316902.804512:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894084736:192.168.202.121@tcp:63:ll_sa.0 00010000:00010000:1.0:1767316902.808474:0:2503:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 4/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.808504:0:2503:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.808512:0:2503:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 4/1,0 mode: --/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.808524:0:2503:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.808534:0:2503:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.808545:0:2503:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.808552:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.808560:0:2503:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.808587:0:2503:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558c700 x1853163894084736/t0(0) o63->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:24/4 lens 680/1176 e 0 to 0 dl 1767316918 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000002:00010000:1.0:1767316902.808615:0:2503:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 552 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767316902.808627:0:2503:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f6b from it ffff9cfe04cee988 00010000:00010000:1.0:1767316902.808631:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.808639:0:2503:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1767316902.808670:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894084736:192.168.202.121@tcp:63:ll_sa.0 00010000:00010000:1.0:1767316902.808692:0:2503:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 4/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.808704:0:2503:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.808710:0:2503:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.808718:0:2503:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.808726:0:2503:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.808733:0:2503:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.808749:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.808755:0:2503:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316902.808763:0:2503:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558ed80 x1853163894084608/t0(0) o63->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:24/4 lens 672/1176 e 0 to 0 dl 1767316918 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000002:00010000:1.0:1767316902.808772:0:2503:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 552 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767316902.808781:0:2503:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f72 from it ffff9cfe04cee188 00010000:00010000:1.0:1767316902.808785:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.808791:0:2503:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1767316902.808806:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894084608:192.168.202.121@tcp:63:ll_sa.0 00010000:00010000:1.0:1767316902.808855:0:52122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316902.808884:0:52122:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x6:0x0](ffff9cfe0ed9ba88) 00000080:00200000:1.0:1767316902.808971:0:52122:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x6:0x0]: layout version change: 4294967294 -> 5 00000080:00010000:1.0:1767316902.808978:0:52122:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x6:0x0](ffff9cfe0ed9ba88) for lock 0xd9a0da65fad56f6b 00000080:00010000:1.0:1767316902.808985:0:52122:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f6b from it ffff9cfe04cee988 00010000:00010000:1.0:1767316902.808994:0:52122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.809000:0:52122:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.809033:0:52122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316902.809046:0:52122:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000405:0x7:0x0](ffff9cfe0ed9d348) 00000080:00200000:1.0:1767316902.809118:0:52122:0:(file.c:6809:ll_layout_conf()) [0x240000405:0x7:0x0]: layout version change: 4294967294 -> 5 00000080:00010000:1.0:1767316902.809122:0:52122:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x7:0x0](ffff9cfe0ed9d348) for lock 0xd9a0da65fad56f72 00000080:00010000:1.0:1767316902.809127:0:52122:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f72 from it ffff9cfe04cee188 00010000:00010000:1.0:1767316902.809130:0:52122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316902.809137:0:52122:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316902.809784:0:83727:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x6:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:2.0:1767316902.809797:0:83727:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x6:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316902.809800:0:83727:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767316902.809803:0:83727:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x6:0x0] 00000008:00010000:2.0:1767316902.809842:0:83727:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:2.0:1767316902.809845:0:83727:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fe30, osc lock ffff9cfe2013d560, flags 0x400000400041012 00010000:00010000:2.0:1767316902.809897:0:83727:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.809920:0:83727:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400041010 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.809932:0:83727:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe29109c00 x1853163894084864/t0(0) o101->lustre-OST0000-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00010000:2.0:1767316902.809964:0:83727:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_release():245 00000020:00010000:2.0:1767316902.809968:0:83727:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316902.809971:0:83727:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fe30 (ffff9cfe0e4c85a8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316902.809974:0:83727:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316902.809977:0:83727:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fe30 (ffff9cfe0e4c8a28/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316902.809987:0:83727:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x6:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:2.0:1767316902.809999:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767316902.810013:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894084864:192.168.202.121@tcp:101:ll_agl.0 00000080:00200000:2.0:1767316902.810132:0:83727:0:(vvp_io.c:1854:vvp_io_init()) [0x240000405:0x7:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1767316902.810138:0:83727:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000405:0x7:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316902.810140:0:83727:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767316902.810142:0:83727:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x240000405:0x7:0x0] 00000008:00010000:2.0:1767316902.810150:0:83727:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:2.0:1767316902.810152:0:83727:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322fe30, osc lock ffff9cfe2013d560, flags 0x400000400041012 00010000:00010000:2.0:1767316902.810177:0:83727:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.810198:0:83727:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400041010 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->16777215] (req 0->16777215) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.810215:0:83727:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe29108a80 x1853163894084992/t0(0) o101->lustre-OST0001-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00010000:2.0:1767316902.810232:0:83727:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_release():245 00000020:00010000:2.0:1767316902.810235:0:83727:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316902.810238:0:83727:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322fe30 (ffff9cfe0e4c85a8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316902.810240:0:83727:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d16480 (ffff9cfe0e4c8a28/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316902.810243:0:83727:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322fe30 (ffff9cfe0e4c8a28/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316902.810249:0:83727:0:(vvp_io.c:289:vvp_io_fini()) [0x240000405:0x7:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:2.0:1767316902.810262:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894084992:192.168.202.121@tcp:101:ll_agl.0 00010000:00010000:0.0:1767316902.810814:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.810859:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0xa:0x0]) in obj [0x200000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.810871:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.810881:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.810890:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.810896:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.810909:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0xa:0x0]) in obj [0x240000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.810916:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.810923:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.810930:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.810936:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.810961:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000400:0x8:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316902.810968:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8:0x0](ffff9cfe187ddb88) 00000080:00010000:0.0:1767316902.810972:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56f56 00000080:00010000:0.0:1767316902.810977:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f56 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316902.810980:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.810985:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.810997:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0xa:0x0]) in obj [0x200000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.811003:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.811011:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.811018:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.811024:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.811032:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0xa:0x0]) in obj [0x240000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.811036:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.811043:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.811056:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.811063:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.811139:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.811146:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=dir.copy, flags=258 00000080:00200000:0.0:1767316902.811161:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8:0x0](ffff9cfe187ddb88), inode mode 41ed mask 44 00000080:00200008:0.0:1767316902.811170:0:83725:0:(file.c:1001:ll_file_open()) START file dir.copy:[0x200000405:0x8:0x0](ffff9cfe187ddb88), flags 704400 00000002:00010000:0.0:1767316902.811692:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8:0x0]) in obj [0x200000405:0x8:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316902.811744:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f87 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.811752:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f87 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316902.811762:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316902.811772:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9500 x1853163894085248/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316902.811781:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f87 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.811799:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894085248:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.811982:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00010000:00010000:2.0:1767316902.816159:0:2505:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->16777215] (req 0->16777215) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.816197:0:2505:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5d4 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.816211:0:2505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad5d4 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.816222:0:2505:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5d4 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767316902.816237:0:2505:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad5d4 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.816250:0:2505:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad5d4 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.816277:0:2505:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad5d4 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.816287:0:2505:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad5d4 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.816295:0:2505:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ad5d4 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767316902.816312:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894084992:192.168.202.121@tcp:101:ll_agl.0 00000100:00100000:0.0:1767316902.817559:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894085248:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.817591:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f87 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.817612:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f87 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.817618:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f87 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.817624:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f87 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.817631:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f87 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.817638:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316902.817642:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f87 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.817648:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f87 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.817655:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f87 lrc: 5/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.817661:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316902.817667:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f87 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.817672:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f87 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316902.817691:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe191d9500 x1853163894085248/t8589937506(8589937506) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316902.817705:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d9500 x1853163894085248/t8589937506(8589937506) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316902.817729:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316902.817762:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x8:0x0], updating i_size 4096 00000002:00100000:0.0:1767316902.817779:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe191d9500 x1853163894085248/t8589937506(8589937506) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316902.817852:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file dir.copy:[0x200000405:0x8:0x0](ffff9cfe187ddb88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316902.817860:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8:0x0](ffff9cfe187ddb88),name=dir.copy 00000002:00010000:0.0:1767316902.817882:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8:0x0]) in obj [0x200000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.817896:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.817916:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.817925:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0xa:0x0]) in obj [0x200000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.817931:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.817937:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.817945:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.817953:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.817966:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0xa:0x0]) in obj [0x240000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.817972:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.817985:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.817993:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.818000:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.818012:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000400:0x8:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316902.818017:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8:0x0](ffff9cfe187ddb88) 00000080:00010000:0.0:1767316902.818020:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8:0x0](ffff9cfe187ddb88) for lock 0xd9a0da65fad56f56 00000080:00010000:0.0:1767316902.818025:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f56 from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316902.818028:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.818035:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.818046:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0xa:0x0]) in obj [0x200000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.818052:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.818060:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.818067:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.818137:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.818148:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0xa:0x0]) in obj [0x240000400:0xa:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.818153:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.818160:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.818167:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.818174:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.818215:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x8:0x0](ffff9cfe187ddb88) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767316902.818229:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.818250:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0xa:0x0]) in obj [0x200000400:0xa:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316902.818258:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.818265:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316902.818868:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894085376:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316902.818972:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00010000:00010000:2.0:1767316902.819410:0:2505:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.819425:0:2505:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5cd expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.819438:0:2505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad5cd expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.819450:0:2505:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad5cd expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767316902.819465:0:2505:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad5cd expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.819478:0:2505:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad5cd expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.819493:0:2505:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad5cd expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.819501:0:2505:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad5cd expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316902.819509:0:2505:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ad5cd expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767316902.819524:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894084864:192.168.202.121@tcp:101:ll_agl.0 00000100:00100000:0.0:1767316902.827442:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894085376:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316902.828126:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.828141:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.828164:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0xa:0x0]) in obj [0x240000400:0xa:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316902.828180:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.828192:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316902.828770:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894085504:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316902.828877:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.840486:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894085504:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316902.841190:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.841206:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.841267:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x8:0x0](ffff9cfe187ddb88) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:0.0:1767316902.841286:0:83725:0:(file.c:424:ll_file_release()) START file dir.copy:[0x200000405:0x8:0x0](ffff9cfe187ddb88), flags 704000 00000002:00100000:0.0:1767316902.841351:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191d9500 x1853163894085248/t8589937506(8589937506) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316902.841373:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316902.841379:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8700 x1853163894085760/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316902.841401:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894085760:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316902.841490:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.849220:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894085760:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316902.849262:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191d9500 x1853163894085248/t8589937506(8589937506) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316902.849324:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.849337:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=dir.copy, flags=0 00000080:00200000:0.0:1767316902.849343:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448), inode mode 41ed mask 3 00000080:00200000:0.0:1767316902.849348:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=dir.copy, dir=[0x200000405:0x3:0x0](ffff9cfe187df448) 00010000:00010000:0.0:1767316902.849381:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.849472:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.849513:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.849521:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 1/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.849526:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316902.849530:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f56 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad572 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.849563:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f3a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad525 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316902.849658:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316902.849665:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d8700 x1853163894086016/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316902.849690:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894086016:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316902.849893:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316902.860542:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316902.860735:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939823488 00000100:00100000:3.0:1767316902.860744:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939823488 00000100:00100000:3.0:1767316902.860842:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10246 00000100:00100000:3.0:1767316902.860852:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:51212:x1853163939823488:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316902.860869:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316902.860992:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316902.861000:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:51212:x1853163939823488:12345-192.168.202.121@tcp:104: Request processed in 150us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316902.861007:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10246 00010000:00010000:0.0:1767316902.864435:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316902.864450:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.864462:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037d000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316902.864468:0:63142:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.864477:0:63142:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.864486:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.865275:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 2/0,0 mode: --/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.865285:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767316902.865341:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894086144:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767316902.865464:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 1/0,0 mode: --/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.865473:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad56f5d lrc: 0/0,0 mode: --/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad580 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.865492:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316902.865508:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316902.865509:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316902.871120:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316902.871206:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939823744 00000100:00100000:3.0:1767316902.871216:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939823744 00000100:00100000:3.0:1767316902.871270:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10247 00000100:00100000:3.0:1767316902.871280:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939823744:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316902.871296:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316902.871386:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316902.871394:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939823744:12345-192.168.202.121@tcp:104: Request processed in 115us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316902.871401:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10247 00010000:00010000:1.0:1767316902.871671:0:63143:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316902.871679:0:63143:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.871688:0:63143:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037ca00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316902.871693:0:63143:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.871701:0:63143:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.871709:0:63143:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.871813:0:63143:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.871820:0:63143:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316902.871851:0:63143:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 1/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.871858:0:63143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad56f64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad58e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.871875:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316902.871877:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316902.871879:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316902.871895:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894086272:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316902.873264:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894086144:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316902.884463:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894086272:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316902.889675:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d8700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894086016:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316902.889736:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x8:0x0](ffff9cfe187ddb88) 00000080:00200000:0.0:1767316902.889806:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.889832:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=dir, dir=[0x200000405:0x3:0x0](ffff9cfe187df448), flags=0 00000080:00200000:0.0:1767316902.889837:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=dir, dir=[0x200000405:0x3:0x0](ffff9cfe187df448), intent=getattr 00000002:00010000:0.0:1767316902.889880:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: dir,[0x0:0x0:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.889952:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.889963:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.889972:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.889993:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894086400:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.890161:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.894132:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894086400:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.894159:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 4/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad628 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.894192:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad628 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.894201:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad628 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.894211:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad628 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.894221:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad628 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.894247:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad628 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.894254:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad628 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.894261:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad628 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.894271:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d9500 x1853163894086400/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/584 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.894283:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad628 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.894292:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 8589935621/7 (0 0) 00000002:00010000:0.0:1767316902.894307:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x7:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.894356:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.894362:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.894370:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.894389:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894086528:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.894477:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.897923:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894086528:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.897970:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.897982:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.897994:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.898006:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.898018:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.898026:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.898033:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.898043:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191da300 x1853163894086528/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/672 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.898055:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.898069:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/7 (0 0) 00000080:00200000:0.0:1767316902.898131:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000400:0x8:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316902.898177:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x7:0x0](ffff9cfe0edc21c8) 00000002:00010000:0.0:1767316902.898226:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x9:0x0]) in obj [0x200000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.898277:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.898285:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.898293:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.898314:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894086656:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.898393:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.902444:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894086656:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.902469:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 4/1,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.902481:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 4/1,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.902492:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.902502:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.902515:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.902523:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.902559:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.902571:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d9500 x1853163894086656/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.902755:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.902768:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935616/9 (0 0) 00010000:00010000:0.0:1767316902.902776:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.902784:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316902.902813:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x9:0x0]) in obj [0x240000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.902875:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.902882:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316902.902891:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316902.902925:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894086784:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316902.903064:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.906728:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894086784:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316902.906768:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 4/1,0 mode: --/CR res: [0x240000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.906780:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.906791:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.906802:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.906813:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.906819:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.906836:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.906848:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191d9500 x1853163894086784/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316902.906861:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.906874:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677440/9 (0 0) 00010000:00010000:0.0:1767316902.906883:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.906901:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.907018:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x7:0x0], updating i_size 8192 00000080:00010000:0.0:1767316902.907030:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x200000405:0x7:0x0](ffff9cfe0edc21c8) for remote lock 0xd9a0da65fad56f95 00000080:00010000:0.0:1767316902.907035:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x7:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad56f8e 00000080:00010000:0.0:1767316902.907045:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x7:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316902.907049:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f8e from it ffffa99f40d87b20 00010000:00010000:0.0:1767316902.907052:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad628 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.907060:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad628 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767316902.907066:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad56f95 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316902.907069:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.907076:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316902.907394:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file dir:[0x200000405:0x7:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316902.907401:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x7:0x0](ffff9cfe0edc21c8),name=dir 00000002:00010000:1.0:1767316902.907425:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x7:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.907434:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.907444:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.907454:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x9:0x0]) in obj [0x200000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.907459:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.907465:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.907472:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.907478:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.907486:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x9:0x0]) in obj [0x240000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.907490:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.907496:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.907511:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.907518:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.907645:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000400:0x8:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316902.907653:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x7:0x0](ffff9cfe0edc21c8) 00000080:00010000:1.0:1767316902.907656:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x7:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad56f95 00000080:00010000:1.0:1767316902.907661:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f95 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316902.907664:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.907671:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.907682:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x9:0x0]) in obj [0x200000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.907688:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.907696:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.907702:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.907709:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.907728:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x9:0x0]) in obj [0x240000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.907734:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.907742:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.907748:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.907753:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.907798:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.907805:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=dir, flags=258 00000080:00200000:1.0:1767316902.907810:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x7:0x0](ffff9cfe0edc21c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767316902.907818:0:83725:0:(file.c:1001:ll_file_open()) START file dir:[0x200000405:0x7:0x0](ffff9cfe0edc21c8), flags 704400 00000002:00010000:1.0:1767316902.907842:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x7:0x0]) in obj [0x200000405:0x7:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767316902.907887:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56faa lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.907894:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56faa lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316902.907997:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316902.908007:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558c700 x1853163894087040/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316902.908016:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56faa lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316902.908044:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894087040:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316902.908375:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acc00 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.911974:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894087040:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316902.911998:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56faa lrc: 4/1,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.912011:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56faa lrc: 4/1,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.912018:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56faa lrc: 4/1,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.912025:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56faa lrc: 3/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.912032:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56faa lrc: 4/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.912039:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316902.912043:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56faa lrc: 4/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.912050:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56faa lrc: 4/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.912057:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56faa lrc: 5/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.912063:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316902.912069:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56faa lrc: 3/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316902.912175:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56faa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:1.0:1767316902.912268:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe0558c700 x1853163894087040/t8589937509(8589937509) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316902.912282:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558c700 x1853163894087040/t8589937509(8589937509) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316902.912299:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x7:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316902.912329:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x7:0x0], updating i_size 4096 00000002:00100000:1.0:1767316902.912348:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558c700 x1853163894087040/t8589937509(8589937509) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316902.912409:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file dir:[0x200000405:0x7:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316902.912417:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x7:0x0](ffff9cfe0edc21c8),name=dir 00000002:00010000:1.0:1767316902.912437:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x7:0x0]) in obj [0x240000400:0x8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.912450:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.912462:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.912473:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x9:0x0]) in obj [0x200000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.912479:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.912487:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.912507:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.912514:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.912528:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x9:0x0]) in obj [0x240000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.912536:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.912544:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.912551:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.912557:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.912566:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000400:0x8:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316902.912652:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x7:0x0](ffff9cfe0edc21c8) 00000080:00010000:1.0:1767316902.912657:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x7:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad56f95 00000080:00010000:1.0:1767316902.912663:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f95 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316902.912666:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.912674:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.912699:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x9:0x0]) in obj [0x200000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.912706:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.912713:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.912720:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.912726:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.912734:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x9:0x0]) in obj [0x240000400:0x9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316902.912738:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.912745:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.912751:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.912758:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.912783:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x7:0x0](ffff9cfe0edc21c8) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767316902.912793:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.912834:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x9:0x0]) in obj [0x200000400:0x9:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316902.912841:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.912849:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316902.913743:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894087168:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316902.913855:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acc00 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.921329:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894087168:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316902.921979:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.921993:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316902.922017:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x9:0x0]) in obj [0x240000400:0x9:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316902.922031:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.922043:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316902.922657:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894087296:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316902.922754:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acc00 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.931068:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894087296:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316902.931761:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.931777:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316902.931847:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x7:0x0](ffff9cfe0edc21c8) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:1.0:1767316902.931867:0:83725:0:(file.c:424:ll_file_release()) START file dir:[0x200000405:0x7:0x0](ffff9cfe0edc21c8), flags 704000 00000002:00100000:1.0:1767316902.931931:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0558c700 x1853163894087040/t8589937509(8589937509) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316902.931943:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316902.931949:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558e300 x1853163894087552/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316902.931971:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894087552:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316902.932060:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acc00 going to sleep for 11 seconds 00000100:00100000:1.0:1767316902.938115:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894087552:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316902.938154:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0558c700 x1853163894087040/t8589937509(8589937509) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316902.938211:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448), inode mode 41ed mask 1 00000080:00200000:1.0:1767316902.938222:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=dir, flags=0 00000080:00200000:1.0:1767316902.938228:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448), inode mode 41ed mask 3 00000080:00200000:1.0:1767316902.938233:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=dir, dir=[0x200000405:0x3:0x0](ffff9cfe187df448) 00010000:00010000:1.0:1767316902.938263:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad628 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.938310:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 1/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad628 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.938330:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316902.938347:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad56f8e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad628 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316902.938368:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316902.938381:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894087680:192.168.202.121@tcp:103:rm.0 00010000:00010000:0.0:1767316902.939022:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.939060:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.939067:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316902.939076:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad56f95 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad636 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316902.939120:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316902.939128:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191da300 x1853163894087936/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316902.939145:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894087936:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316902.939867:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316902.947242:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:1.0:1767316902.947354:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894087680:192.168.202.121@tcp:103:rm.0 00000100:00100000:3.0:1767316902.947508:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939825024 00000100:00100000:3.0:1767316902.947516:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939825024 00000100:00100000:3.0:1767316902.947567:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10248 00000100:00100000:3.0:1767316902.947586:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939825024:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316902.947603:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316902.947680:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316902.947687:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939825024:12345-192.168.202.121@tcp:104: Request processed in 111us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316902.947695:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10248 00010000:00010000:1.0:1767316902.947953:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316902.947960:0:59093:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.947968:0:59093:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037d200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316902.947973:0:59093:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.947981:0:59093:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.947989:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.948125:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.948133:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316902.948156:0:59093:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.948177:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad56f41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad533 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316902.948194:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316902.948196:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316902.948198:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316902.948205:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316902.948218:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894088064:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316902.955973:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894088064:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316902.957478:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316902.958277:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939825920 00000100:00100000:2.0:1767316902.958287:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939825920 00000100:00100000:2.0:1767316902.958374:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10249 00000100:00100000:2.0:1767316902.958385:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:51212:x1853163939825920:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316902.958403:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316902.958492:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316902.958499:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:51212:x1853163939825920:12345-192.168.202.121@tcp:104: Request processed in 117us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316902.958507:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10249 00010000:00010000:0.0:1767316902.958550:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316902.958557:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.958566:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316902.958571:0:42049:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.958589:0:42049:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.958598:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.958705:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 2/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.958713:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316902.958740:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 1/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.958747:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56f9c lrc: 0/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad644 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.958776:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.958778:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.958780:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316902.959109:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894088192:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316902.963147:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316902.963176:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939826176 00000100:00100000:3.0:1767316902.963198:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939826176 00000100:00100000:3.0:1767316902.963249:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10250 00000100:00100000:3.0:1767316902.963258:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:16197:x1853163939826176:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316902.963276:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316902.963345:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316902.963352:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:9a586faf-b087-472d-9665-d3bc7d15b908+5:16197:x1853163939826176:12345-192.168.202.121@tcp:104: Request processed in 95us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316902.963374:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10250 00010000:00010000:0.0:1767316902.963781:0:63840:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316902.963789:0:63840:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.963797:0:63840:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316902.963802:0:63840:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.963810:0:63840:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.963818:0:63840:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.963934:0:63840:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.963941:0:63840:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316902.963960:0:63840:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.963966:0:63840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fa3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x9:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad652 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.963985:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.963986:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316902.963995:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316902.964024:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894088320:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316902.970950:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894088320:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316902.972370:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894088192:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316902.979512:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191da300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894087936:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316902.979556:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x7:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316902.979637:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.979654:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f46.sanity-flr.copy, dir=[0x200000405:0x3:0x0](ffff9cfe187df448), flags=0 00000080:00200000:0.0:1767316902.979659:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f46.sanity-flr.copy, dir=[0x200000405:0x3:0x0](ffff9cfe187df448), intent=getattr 00010000:00010000:0.0:1767316902.979681:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316902.979695:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f6b from it ffffa99f40d87be8 00010000:00010000:0.0:1767316902.979700:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316902.979708:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316902.979737:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448), inode mode 41ed mask 3 00000080:00200000:0.0:1767316902.979743:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f46.sanity-flr.copy, dir=[0x200000405:0x3:0x0](ffff9cfe187df448) 00010000:00010000:0.0:1767316902.979778:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316902.979795:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x6:0x0]: losing layout lock 00010000:00010000:0.0:1767316902.979846:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 1/0,0 mode: --/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316902.979854:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316902.979869:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad56f6b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad5c6 expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767316902.979894:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316902.979914:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9880 x1853163894088576/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316902.979936:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894088576:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316902.980016:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00010000:00010000:0.0:1767316902.981047:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316902.984884:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894088576:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316902.984956:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316902.984968:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x6:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316902.984971:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316902.984977:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1767316902.984988:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x0 00020000:00200000:0.0:1767316902.984990:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x0 00000080:00200000:0.0:1767316902.985010:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316902.985018:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x6:0x0](ffff9cfe0ed9ba88) 00000080:00200000:0.0:1767316902.985165:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.985195:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f46.sanity-flr, dir=[0x200000405:0x3:0x0](ffff9cfe187df448), flags=0 00000080:00200000:0.0:1767316902.985200:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f46.sanity-flr, dir=[0x200000405:0x3:0x0](ffff9cfe187df448), intent=getattr 00010000:00010000:0.0:1767316902.985221:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1767316902.985235:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f72 from it ffffa99f40d87be8 00010000:00010000:0.0:1767316902.985239:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316902.985267:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316902.985290:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448), inode mode 41ed mask 3 00000080:00200000:0.0:1767316902.985296:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f46.sanity-flr, dir=[0x200000405:0x3:0x0](ffff9cfe187df448) 00010000:00010000:0.0:1767316902.985333:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316902.985351:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x240000405:0x7:0x0]: losing layout lock 00010000:00010000:0.0:1767316902.985392:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316902.985399:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316902.985402:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad56f72 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad5aa expref: -99 pid: 83726 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767316902.985426:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316902.985435:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191d9500 x1853163894088832/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316902.985458:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894088832:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316902.985540:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.990990:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191d9500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894088832:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316902.991051:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x240000405:0x7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316902.991064:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000405:0x7:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316902.991068:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316902.991074:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[3] flags 0x10 00020000:00200000:0.0:1767316902.991136:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[4] flags 0x0 00000080:00200000:0.0:1767316902.991154:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x240000405:0x7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316902.991161:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000405:0x7:0x0](ffff9cfe0ed9d348) 00000080:00200008:0.0:1767316902.991265:0:83725:0:(file.c:424:ll_file_release()) START file d46.sanity-flr:[0x200000405:0x3:0x0](ffff9cfe187df448), flags 704000 00010000:00010000:0.0:1767316902.991292:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f4f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad54f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.991328:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316902.991344:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.991351:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.991358:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.991365:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316902.991372:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316902.991375:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56f2c 00000080:00010000:0.0:1767316902.991382:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f2c from it ffffa99f40d87c10 00010000:00010000:0.0:1767316902.991386:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.991394:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.991408:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316902.991419:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d46.sanity-flr, flags=0 00000080:00200000:0.0:1767316902.991426:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316902.991433:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316902.991438:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.991453:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.991459:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316902.991464:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316902.991466:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56f2c 00000080:00010000:0.0:1767316902.991470:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56f2c from it ffffa99f40d87d88 00010000:00010000:0.0:1767316902.991473:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.991480:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316902.991490:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316902.991496:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d46.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316902.991517:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.991541:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f4f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad54f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316902.991600:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191db100 x1853163894084096/t8589937505(8589937505) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316902.991612:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316902.991617:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f800 x1853163894089088/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316902.991638:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894089088:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316902.991733:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316902.995804:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894089088:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316902.995852:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191db100 x1853163894084096/t8589937505(8589937505) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316918 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767316902.995903:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.995960:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f4f lrc: 1/0,0 mode: --/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad54f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.995968:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.995975:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.995981:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1767316902.995984:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56f4f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad54f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.995995:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56f33 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad517 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316902.996007:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56f2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad4fb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316902.996024:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316902.996030:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18f3f800 x1853163894089344/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316902.996071:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894089344:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316902.996199:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.010292:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18f3f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894089344:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316903.010338:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x3:0x0](ffff9cfe187df448) 00000080:00200000:0.0:1767316903.010417:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.010442:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.010501:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.010512:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.010521:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.010541:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894089472:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.010639:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.013435:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894089472:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.013462:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.013474:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.013486:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.013496:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.013525:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.013533:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.013540:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.013551:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191db100 x1853163894089472/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.013565:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.013589:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316903.013596:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316903.013622:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316903.013627:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56fb1 00000080:00010000:0.0:1767316903.013632:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.013635:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56fb1 from it ffffa99f40d87b58 00010000:00010000:0.0:1767316903.013638:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.013646:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.013670:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.013696:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d4.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316903.013700:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d4.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316903.013721:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d4.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.013758:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.013765:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.013773:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.013792:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894089600:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.013875:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.018976:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894089600:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.019002:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.019024:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.019033:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.019044:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.019054:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.019102:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.019111:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.019119:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.019130:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191db100 x1853163894089600/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/672 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.019143:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.019153:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/36 (0 0) 00000080:00200000:0.0:1767316903.019160:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316903.019213:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8) 00000002:00010000:0.0:1767316903.019240:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.019292:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.019299:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.019307:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.019326:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894089728:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.019674:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.023521:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894089728:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.023546:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 4/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.023557:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.023568:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.023590:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.023600:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.023608:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.023614:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.023624:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11320a80 x1853163894089728/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.023639:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.023653:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935616/5 (0 0) 00010000:00010000:0.0:1767316903.023662:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.023684:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.023713:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.023759:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.023766:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.023774:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.023796:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894089856:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.023880:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.026165:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894089856:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.026187:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 4/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026197:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026208:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026217:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026227:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026248:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026256:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.026267:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11320a80 x1853163894089856/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.026279:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026291:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677440/5 (0 0) 00010000:00010000:0.0:1767316903.026298:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026305:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.026334:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x24:0x0], updating i_size 8192 00000080:00010000:0.0:1767316903.026345:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x24:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad56fb8 00000080:00010000:0.0:1767316903.026356:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x24:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316903.026360:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56fb8 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316903.026363:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026371:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316903.026413:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d4.sanity-flr:[0x200000402:0x24:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316903.026419:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8),name=d4.sanity-flr 00000002:00010000:0.0:1767316903.026443:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x24:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.026452:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026462:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.026471:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.026477:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026484:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026492:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026499:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.026507:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.026512:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026518:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026537:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026544:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.026552:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316903.026558:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x24:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316903.026561:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x24:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad56fb8 00000080:00010000:0.0:1767316903.026565:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56fb8 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316903.026568:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026589:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.026599:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.026605:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026612:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026619:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026625:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.026642:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.026646:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026654:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026661:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026667:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.026720:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.026729:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.026736:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026744:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.026749:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.026753:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.026756:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56fb1 00000080:00010000:0.0:1767316903.026759:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56fb1 from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316903.026762:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.026778:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.026787:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.026793:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d4.sanity-flr, flags=266 00000080:00200000:0.0:1767316903.026798:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767316903.026807:0:83725:0:(file.c:1001:ll_file_open()) START file d4.sanity-flr:[0x200000402:0x24:0x0](ffff9cfe0edc21c8), flags 704400 00000002:00010000:0.0:1767316903.026833:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x24:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316903.026879:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56fcd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.026885:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56fcd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316903.026897:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316903.026916:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11320a80 x1853163894090112/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316903.026925:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56fcd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.026946:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894090112:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.027151:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.030419:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894090112:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.030443:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56fcd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.030457:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56fcd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.030477:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56fcd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.030484:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56fcd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.030491:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56fcd lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.030498:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316903.030502:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56fcd lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.030510:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56fcd lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.030517:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56fcd lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.030523:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316903.030529:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56fcd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.030535:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad56fcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316903.030556:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe11320a80 x1853163894090112/t8589937515(8589937515) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316903.030569:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11320a80 x1853163894090112/t8589937515(8589937515) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316903.030599:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316903.030640:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x24:0x0], updating i_size 4096 00000002:00100000:0.0:1767316903.030657:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11320a80 x1853163894090112/t8589937515(8589937515) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316903.030723:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d4.sanity-flr:[0x200000402:0x24:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316903.030730:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8),name=d4.sanity-flr 00000002:00010000:0.0:1767316903.030751:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x24:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.030767:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.030781:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.030793:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.030798:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.030806:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.030814:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.030833:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.030851:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.030858:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.030876:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.030885:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.030893:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.032467:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316903.032489:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x24:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316903.032496:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x24:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad56fb8 00000080:00010000:0.0:1767316903.032504:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56fb8 from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316903.032509:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.032521:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.032549:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.032560:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.032580:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.032589:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.032614:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.032624:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.032630:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.032638:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.032645:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.032652:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.032689:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767316903.032704:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.032730:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316903.032735:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.032743:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316903.033369:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323b80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894090240:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316903.034385:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.041602:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323b80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894090240:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316903.042621:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.042642:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.043515:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316903.043536:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.043552:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316903.044425:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894090368:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316903.044531:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.050809:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894090368:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316903.051429:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.051460:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316903.051530:0:83725:0:(file.c:424:ll_file_release()) START file d4.sanity-flr:[0x200000402:0x24:0x0](ffff9cfe0edc21c8), flags 704000 00000002:00100000:1.0:1767316903.051585:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe11320a80 x1853163894090112/t8589937515(8589937515) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316903.051597:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316903.051603:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558e300 x1853163894090624/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316903.051622:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894090624:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316903.051705:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.056497:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894090624:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316903.056536:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe11320a80 x1853163894090112/t8589937515(8589937515) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316903.056631:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.056650:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.056667:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.056681:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.056688:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.056694:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.056697:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56fb1 00000080:00010000:1.0:1767316903.056716:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56fb1 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316903.056720:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.056729:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.056744:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.056751:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d4.sanity-flr, flags=266 00000080:00200000:1.0:1767316903.056758:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767316903.056766:0:83725:0:(file.c:1001:ll_file_open()) START file d4.sanity-flr:[0x200000402:0x24:0x0](ffff9cfe0edc21c8), flags 704400 00000002:00010000:1.0:1767316903.056782:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x24:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767316903.056838:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56fd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.056846:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56fd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316903.056858:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316903.056865:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558e300 x1853163894090880/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316903.056874:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56fd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.056895:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894090880:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.057192:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.061311:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894090880:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.061345:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56fd4 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad76a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.061374:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56fd4 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad76a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.061387:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56fd4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad76a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.061397:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56fd4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad76a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.061413:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe0558e300 x1853163894090880/t8589937517(8589937517) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316903.061426:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558e300 x1853163894090880/t8589937517(8589937517) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.061441:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56fd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad76a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.061452:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935618/36 (0 0) 00000080:00200000:1.0:1767316903.061459:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.061490:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x24:0x0], updating i_size 4096 00000080:00010000:1.0:1767316903.061496:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x24:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad56fd4 00000080:00010000:1.0:1767316903.061504:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56fd4 from it ffffa99f40d87bd0 00010000:00010000:1.0:1767316903.061508:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56fd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad76a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.061517:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56fd4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad76a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.061553:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558e300 x1853163894090880/t8589937517(8589937517) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316903.061689:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d4.sanity-flr:[0x200000402:0x24:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316903.061696:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8),name=d4.sanity-flr 00000002:00010000:1.0:1767316903.061717:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x24:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.061727:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.061739:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.061749:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.061754:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.061762:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.061769:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.061775:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.061784:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.061791:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.061811:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.061819:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.061838:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.061848:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316903.061855:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x24:0x0](ffff9cfe0edc21c8) 00000080:00010000:1.0:1767316903.061859:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x24:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad56fb8 00000080:00010000:1.0:1767316903.061863:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56fb8 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316903.061866:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.061873:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.061885:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.061891:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.061899:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.061999:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.062016:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.062026:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.062032:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.062040:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.062048:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.062054:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.062386:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767316903.062402:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.062426:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316903.062432:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.062440:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767316903.062453:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767316903.062457:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.062468:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.062479:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316903.062485:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.062493:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767316903.062503:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767316903.062506:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.062512:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.062546:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:1.0:1767316903.062570:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.062667:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f4.sanity-flr, dir=[0x200000402:0x24:0x0](ffff9cfe0edc21c8), flags=0 00000080:00200000:1.0:1767316903.062672:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f4.sanity-flr, dir=[0x200000402:0x24:0x0](ffff9cfe0edc21c8), intent=getattr 00000002:00010000:1.0:1767316903.062688:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f4.sanity-flr,[0x0:0x0:0x0]) in obj [0x240000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.062735:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.062742:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.062751:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.062780:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894091008:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.063037:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.066873:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894091008:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.066973:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 4/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad78d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.067000:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 4/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad78d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.067008:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 4/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad78d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.067020:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad78d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.067031:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad78d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.067043:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad78d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.067051:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 5/2,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad78d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.067059:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad78d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.067071:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558c700 x1853163894091008/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/1032 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.067254:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 448 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad78d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.067269:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad78d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.067280:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677441/8 (0 0) 00000080:00200000:1.0:1767316903.067286:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000400:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316903.067325:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000401:0x8:0x0](ffff9cfe0ed9ec08) 00000080:00200000:1.0:1767316903.067409:0:83725:0:(file.c:6809:ll_layout_conf()) [0x240000401:0x8:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:1.0:1767316903.067416:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000401:0x8:0x0](ffff9cfe0ed9ec08) for lock 0xd9a0da65fad56fdb 00000080:00010000:1.0:1767316903.067425:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000401:0x8:0x0](ffff9cfe0ed9ec08) 00000080:00010000:1.0:1767316903.067428:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56fdb from it ffffa99f40d87df8 00010000:00010000:1.0:1767316903.067432:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad78d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.067440:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ad78d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316903.067481:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767316903.067491:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f4.sanity-flr, dir=[0x200000402:0x24:0x0](ffff9cfe0edc21c8) 00010000:00010000:1.0:1767316903.067526:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.067690:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ad78d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316903.067702:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x240000401:0x8:0x0]: losing layout lock 00010000:00010000:1.0:1767316903.067745:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 1/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad78d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.067753:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.067758:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316903.067761:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fdb lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad78d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.067777:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad56fc6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad74e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316903.067795:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316903.067803:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558c700 x1853163894091264/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316903.067839:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894091264:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316903.068127:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.072415:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558c700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894091264:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316903.072473:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x240000401:0x8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316903.072489:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000401:0x8:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316903.072492:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316903.072499:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1767316903.072510:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1767316903.072530:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x240000401:0x8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316903.072538:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000401:0x8:0x0](ffff9cfe0ed9ec08) 00000080:00200000:1.0:1767316903.072701:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.072724:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=td, dir=[0x200000402:0x24:0x0](ffff9cfe0edc21c8), flags=0 00000080:00200000:1.0:1767316903.072744:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=td, dir=[0x200000402:0x24:0x0](ffff9cfe0edc21c8), intent=getattr 00000002:00010000:1.0:1767316903.072768:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: td,[0x0:0x0:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.072833:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.072843:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.072853:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.072876:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894091392:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.073211:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.077302:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894091392:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.077321:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 4/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.077338:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.077344:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.077352:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.077358:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.077367:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.077387:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.077392:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.077399:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558d880 x1853163894091392/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/672 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.077408:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.077414:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/37 (0 0) 00000080:00200000:1.0:1767316903.077419:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000400:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316903.077452:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x25:0x0](ffff9cfe0ed9ec08) 00000002:00010000:1.0:1767316903.077480:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x6:0x0]) in obj [0x200000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.077522:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.077527:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.077536:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.077554:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894091520:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.077749:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.080764:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894091520:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.080795:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 4/1,0 mode: --/CR res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.080838:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.080852:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.080863:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.080876:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.080882:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 5/2,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.080889:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.080900:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558ce00 x1853163894091520/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.081004:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.081019:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935616/6 (0 0) 00010000:00010000:1.0:1767316903.081027:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.081035:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.081074:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x6:0x0]) in obj [0x240000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.081282:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.081290:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.081298:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.081322:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894091648:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.081452:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.084547:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894091648:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.084643:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 4/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.084657:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.084668:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.084680:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.084694:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.084702:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.084726:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.084739:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558ce00 x1853163894091648/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.084753:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.084766:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677440/6 (0 0) 00010000:00010000:1.0:1767316903.084774:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.084782:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.085153:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x25:0x0], updating i_size 8192 00000080:00010000:1.0:1767316903.085167:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x25:0x0](ffff9cfe0ed9ec08) for lock 0xd9a0da65fad56fe2 00000080:00010000:1.0:1767316903.085280:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x25:0x0](ffff9cfe0ed9ec08) 00000080:00010000:1.0:1767316903.085285:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56fe2 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316903.085290:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.085298:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316903.085334:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file td:[0x200000402:0x25:0x0](ffff9cfe0ed9ec08), request_mask 2047, flags 0, foreign 0 00000002:00010000:1.0:1767316903.085368:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316903.085384:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.085394:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767316903.085408:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767316903.085411:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.085418:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.085429:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316903.085471:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.085478:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.085489:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.085509:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894091776:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.085758:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.088712:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894091776:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.088746:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.088763:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.088797:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=4 disposition=0, status=0 req@ffff9cfe0558d880 x1853163894091776/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 328/344 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1767316903.089782:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894091904:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316903.089959:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.096404:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894091904:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316903.097308:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.097545:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.098403:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x25:0x0](ffff9cfe0ed9ec08),name=td 00000002:00010000:1.0:1767316903.098432:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x25:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.098449:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.098464:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.098477:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x6:0x0]) in obj [0x200000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.098483:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.098491:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.098500:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.098516:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.098529:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x6:0x0]) in obj [0x240000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.098536:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.098544:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.098551:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.098557:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.098567:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000400:0x5:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316903.098586:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x25:0x0](ffff9cfe0ed9ec08) 00000080:00010000:1.0:1767316903.098590:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x25:0x0](ffff9cfe0ed9ec08) for lock 0xd9a0da65fad56fe2 00000080:00010000:1.0:1767316903.098595:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56fe2 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316903.098598:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.098604:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.098615:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x6:0x0]) in obj [0x200000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.098620:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.098633:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.098641:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.098647:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.098655:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x6:0x0]) in obj [0x240000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.098660:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.098667:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.098673:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.098679:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.098726:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.098733:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=td, flags=258 00000080:00200000:1.0:1767316903.098743:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x25:0x0](ffff9cfe0ed9ec08), inode mode 41ed mask 44 00000080:00200008:1.0:1767316903.098751:0:83725:0:(file.c:1001:ll_file_open()) START file td:[0x200000402:0x25:0x0](ffff9cfe0ed9ec08), flags 704400 00000002:00010000:1.0:1767316903.098766:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x25:0x0]) in obj [0x200000402:0x25:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767316903.098816:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ffe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.098839:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ffe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316903.098854:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316903.098865:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558d880 x1853163894092160/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316903.098873:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ffe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.098895:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894092160:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.099107:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000002:00010000:0.0:1767316903.102933:0:83728:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x5:0x0]) in obj [0x200000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316903.102962:0:83728:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.102983:0:83728:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767316903.103001:0:83728:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767316903.103006:0:83728:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.103015:0:83728:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.103034:0:83728:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x5:0x0]) in obj [0x240000400:0x5:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316903.103042:0:83728:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.103052:0:83728:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767316903.103076:0:83728:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767316903.103119:0:83728:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.103126:0:83728:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316903.105458:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894092160:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.105481:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ffe lrc: 4/1,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.105494:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ffe lrc: 4/1,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.105499:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ffe lrc: 4/1,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.105503:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ffe lrc: 3/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.105508:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ffe lrc: 4/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.105512:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316903.105515:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ffe lrc: 4/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.105533:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ffe lrc: 4/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.105540:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ffe lrc: 5/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.105547:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316903.105554:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ffe lrc: 3/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.105560:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad56ffe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:1.0:1767316903.105652:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe0558d880 x1853163894092160/t8589937518(8589937518) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316903.105665:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558d880 x1853163894092160/t8589937518(8589937518) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316903.105683:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000402:0x25:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.105719:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x25:0x0], updating i_size 4096 00000002:00100000:1.0:1767316903.105737:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558d880 x1853163894092160/t8589937518(8589937518) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316903.106020:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file td:[0x200000402:0x25:0x0](ffff9cfe0ed9ec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316903.106029:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x25:0x0](ffff9cfe0ed9ec08),name=td 00000002:00010000:1.0:1767316903.106050:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x25:0x0]) in obj [0x200000400:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.106064:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.106075:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.106314:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x6:0x0]) in obj [0x200000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.106322:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.106330:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.106338:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.106345:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.106358:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x6:0x0]) in obj [0x240000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.106364:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.106371:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.106378:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.106384:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.106392:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000400:0x5:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316903.106399:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x25:0x0](ffff9cfe0ed9ec08) 00000080:00010000:1.0:1767316903.106402:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x25:0x0](ffff9cfe0ed9ec08) for lock 0xd9a0da65fad56fe2 00000080:00010000:1.0:1767316903.106414:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56fe2 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316903.106418:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.106423:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.106436:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x6:0x0]) in obj [0x200000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.106441:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.106447:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.106453:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.106459:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.106466:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x6:0x0]) in obj [0x240000400:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.106470:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.106477:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.106484:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.106500:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.106531:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x25:0x0](ffff9cfe0ed9ec08) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767316903.106543:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.106567:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000400:0x6:0x0]) in obj [0x200000400:0x6:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316903.106585:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.106594:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316903.107401:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894092288:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316903.107557:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.119251:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894092288:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316903.120052:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.120068:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.120183:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000400:0x6:0x0]) in obj [0x240000400:0x6:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316903.120200:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.120234:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316903.121439:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894092416:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316903.121897:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.128283:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894092416:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316903.128969:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.128984:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.129044:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x25:0x0](ffff9cfe0ed9ec08) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:0.0:1767316903.129066:0:83725:0:(file.c:424:ll_file_release()) START file td:[0x200000402:0x25:0x0](ffff9cfe0ed9ec08), flags 704000 00000002:00100000:0.0:1767316903.129172:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0558d880 x1853163894092160/t8589937518(8589937518) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316903.129184:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316903.129190:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11323b80 x1853163894092672/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316903.129213:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323b80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894092672:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316903.129436:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.134871:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323b80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894092672:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316903.134929:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0558d880 x1853163894092160/t8589937518(8589937518) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316903.135002:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.135015:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=td, flags=0 00000080:00200000:0.0:1767316903.135022:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767316903.135027:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=td, dir=[0x200000402:0x24:0x0](ffff9cfe0edc21c8) 00010000:00010000:0.0:1767316903.135060:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.135223:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.135267:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.135274:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 1/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.135279:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316903.135282:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad56fe2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad7c5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.135299:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad56fbf lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad740 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316903.135318:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316903.135324:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11323b80 x1853163894092928/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 488/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316903.135364:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323b80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894092928:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316903.135458:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316903.139279:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316903.139392:0:56325:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767316903.139411:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939828864 00000100:00100000:3.0:1767316903.139420:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939828864 00000100:00100000:3.0:1767316903.139474:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10251 00000100:00100000:3.0:1767316903.139485:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe28138850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15468:x1853163939828864:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316903.139502:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.139585:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316903.139592:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe28138850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15468:x1853163939828864:12345-192.168.202.121@tcp:104: Request processed in 110us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316903.139600:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10251 00010000:00010000:0.0:1767316903.139750:0:49629:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316903.139758:0:49629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.139767:0:49629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316903.139772:0:49629:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.139780:0:49629:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.139788:0:49629:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.139901:0:49629:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.139908:0:49629:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316903.139930:0:49629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 1/0,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.139937:0:49629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad56fe9 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad7d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.139952:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316903.139954:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316903.139963:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316903.139972:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316903.139987:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894093056:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316903.143418:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894093056:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316903.146363:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316903.146587:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939829120 00000100:00100000:3.0:1767316903.146597:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939829120 00000100:00100000:3.0:1767316903.146651:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10252 00000100:00100000:3.0:1767316903.146660:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939829120:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316903.146678:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.146804:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316903.146812:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939829120:12345-192.168.202.121@tcp:104: Request processed in 153us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316903.146828:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10252 00010000:00010000:1.0:1767316903.147763:0:63296:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316903.147773:0:63296:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.147783:0:63296:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2cc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316903.147789:0:63296:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.147797:0:63296:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.147806:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.147947:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.147956:0:63296:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767316903.148017:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894093184:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767316903.148158:0:63296:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.148167:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad56ff0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad7e1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.148185:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316903.148187:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316903.148198:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316903.157631:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894093184:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316903.166748:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323b80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894092928:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316903.166789:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x25:0x0](ffff9cfe0ed9ec08) 00000080:00200008:0.0:1767316903.166873:0:83725:0:(file.c:424:ll_file_release()) START file d4.sanity-flr:[0x200000402:0x24:0x0](ffff9cfe0edc21c8), flags 704000 00010000:00010000:0.0:1767316903.166919:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56fd4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad76a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.166958:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.166977:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.166986:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.166995:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.167002:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.167007:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.167011:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56fb1 00000080:00010000:0.0:1767316903.167017:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56fb1 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316903.167021:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.167047:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.167063:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.167073:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d4.sanity-flr, flags=0 00000080:00200000:0.0:1767316903.167129:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.167140:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.167146:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.167155:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.167161:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.167165:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.167168:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad56fb1 00000080:00010000:0.0:1767316903.167171:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56fb1 from it ffffa99f40d87d88 00010000:00010000:0.0:1767316903.167174:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.167192:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.167200:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316903.167206:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d4.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316903.167227:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.167262:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56fd4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad76a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.167306:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0558e300 x1853163894090880/t8589937517(8589937517) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316903.167316:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316903.167321:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11321500 x1853163894093440/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316903.167341:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894093440:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316903.167432:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.172289:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894093440:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316903.172329:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0558e300 x1853163894090880/t8589937517(8589937517) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767316903.172384:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.172434:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56fd4 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad76a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.172443:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.172449:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.172455:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1767316903.172475:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad56fd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad76a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.172486:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad56fb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad732 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.172499:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad56fb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad716 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316903.172518:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316903.172525:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11321500 x1853163894093696/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316903.172549:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894093696:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316903.172706:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316903.177894:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316903.178050:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939830016 00000100:00100000:3.0:1767316903.178062:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939830016 00000100:00100000:3.0:1767316903.178163:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10253 00000100:00100000:3.0:1767316903.178173:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939830016:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316903.178202:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.178266:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316903.178272:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939830016:12345-192.168.202.121@tcp:104: Request processed in 100us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316903.178279:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10253 00010000:00010000:1.0:1767316903.178423:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316903.178430:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.178439:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2ce00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316903.178443:0:63142:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.178452:0:63142:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.178460:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.178651:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.178658:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316903.178691:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.178698:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad56ff7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad7e8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.178715:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316903.178717:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316903.178719:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316903.178727:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316903.178742:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894093824:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316903.190340:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894093824:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316903.200260:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894093696:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316903.200298:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x24:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316903.200392:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.200418:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.200479:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.200489:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.200499:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.200518:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894093952:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.200627:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.203953:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894093952:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.203982:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.203996:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.204007:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.204017:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.204029:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.204037:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.204044:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.204055:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322d80 x1853163894093952/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.204069:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.204117:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316903.204125:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316903.204165:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316903.204170:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57005 00000080:00010000:0.0:1767316903.204177:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.204191:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57005 from it ffffa99f40d87b58 00010000:00010000:0.0:1767316903.204196:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.204204:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.204229:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.204250:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316903.204254:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316903.204277:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.204316:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.204323:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.204332:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.204352:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894094080:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.204437:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.207600:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894094080:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.207623:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.207643:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 4/1,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.207665:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 4/1,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.207676:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.207686:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.207697:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.207704:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.207711:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.207721:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322d80 x1853163894094080/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.207733:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.207742:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 9663677445/8 (0 0) 00000002:00010000:0.0:1767316903.207755:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000405:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.207793:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.207807:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.207816:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.207847:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894094208:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.207920:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.210679:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894094208:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.210702:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.210714:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.210724:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.210732:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.210740:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.210745:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.210750:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.210773:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11321f80 x1853163894094208/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.210782:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.210790:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/8 (0 0) 00000080:00200000:0.0:1767316903.210805:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316903.210839:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000405:0x8:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316903.210846:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x8:0x0], updating i_size 4096 00000080:00010000:0.0:1767316903.210853:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000405:0x8:0x0](ffff9cfe0edc21c8) for remote lock 0xd9a0da65fad57013 00000080:00010000:0.0:1767316903.210858:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x8:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad5700c 00000080:00010000:0.0:1767316903.210866:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x8:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316903.210870:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5700c from it ffffa99f40d87b20 00010000:00010000:0.0:1767316903.210874:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.210881:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767316903.210894:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad57013 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316903.210897:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.210903:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316903.210934:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d50a.sanity-flr:[0x240000405:0x8:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316903.210947:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0x8:0x0](ffff9cfe0edc21c8),name=d50a.sanity-flr 00000002:00010000:0.0:1767316903.210970:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x8:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.210978:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.210988:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.210995:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.211000:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x8:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316903.211003:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x8:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad57013 00000080:00010000:0.0:1767316903.211007:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57013 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316903.211010:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.211016:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.211065:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.211073:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.211433:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.211443:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.211450:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.211455:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.211458:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57005 00000080:00010000:0.0:1767316903.211469:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57005 from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316903.211472:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.211479:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.211488:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.211495:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50a.sanity-flr, flags=266 00000080:00200000:0.0:1767316903.211500:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x8:0x0](ffff9cfe0edc21c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767316903.211508:0:83725:0:(file.c:1001:ll_file_open()) START file d50a.sanity-flr:[0x240000405:0x8:0x0](ffff9cfe0edc21c8), flags 704400 00000002:00010000:0.0:1767316903.211525:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x8:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316903.211635:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5701a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.211643:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5701a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316903.211654:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316903.211661:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11321f80 x1853163894094464/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316903.211670:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5701a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.211691:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894094464:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.211886:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.213949:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894094464:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.213970:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5701a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.214000:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5701a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.214006:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5701a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.214012:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5701a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.214018:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5701a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.214024:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316903.214028:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5701a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.214035:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5701a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.214041:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5701a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.214048:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316903.214054:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5701a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.214060:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5701a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316903.214340:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe11321f80 x1853163894094464/t4294975959(4294975959) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316903.214353:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11321f80 x1853163894094464/t4294975959(4294975959) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316903.214374:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316903.214393:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x8:0x0], updating i_size 4096 00000002:00100000:0.0:1767316903.214413:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11321f80 x1853163894094464/t4294975959(4294975959) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316903.214475:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d50a.sanity-flr:[0x240000405:0x8:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316903.214483:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0x8:0x0](ffff9cfe0edc21c8),name=d50a.sanity-flr 00000002:00010000:0.0:1767316903.214503:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x8:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.214515:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.214525:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.214531:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.214537:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x8:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316903.214540:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x8:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad57013 00000080:00010000:0.0:1767316903.214545:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57013 from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316903.214548:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.214555:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.214595:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0x8:0x0](ffff9cfe0edc21c8) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767316903.214607:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x8:0x0]) in obj [0x240000405:0x8:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316903.214613:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.214632:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316903.215515:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894094592:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316903.215793:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.222394:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894094592:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316903.223242:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.223258:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316903.223324:0:83725:0:(file.c:424:ll_file_release()) START file d50a.sanity-flr:[0x240000405:0x8:0x0](ffff9cfe0edc21c8), flags 704000 00000002:00100000:0.0:1767316903.223394:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe11321f80 x1853163894094464/t4294975959(4294975959) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316903.223406:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316903.223411:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11322d80 x1853163894094848/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316903.223434:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894094848:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316903.223527:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.226616:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894094848:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316903.226657:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe11321f80 x1853163894094464/t4294975959(4294975959) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316903.226747:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.226785:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.226803:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.226817:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.226834:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.226840:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.226844:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57005 00000080:00010000:0.0:1767316903.226851:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57005 from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316903.226855:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.226863:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.226878:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.226885:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50a.sanity-flr, flags=266 00000080:00200000:0.0:1767316903.226892:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x8:0x0](ffff9cfe0edc21c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767316903.226900:0:83725:0:(file.c:1001:ll_file_open()) START file d50a.sanity-flr:[0x240000405:0x8:0x0](ffff9cfe0edc21c8), flags 704400 00000002:00010000:0.0:1767316903.226923:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x8:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1767316903.226973:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57021 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.226979:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57021 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316903.226988:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316903.226994:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11322d80 x1853163894095104/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316903.227008:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57021 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.227026:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894095104:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.227375:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.230583:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894095104:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.230625:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57021 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad89e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.230635:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57021 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad89e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.230646:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57021 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad89e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.230656:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57021 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad89e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.230669:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe11322d80 x1853163894095104/t4294975961(4294975961) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316903.230681:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11322d80 x1853163894095104/t4294975961(4294975961) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.230691:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57021 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad89e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.230701:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 16 res 9663677445/8 (0 0) 00000080:00200000:0.0:1767316903.230707:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316903.230741:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x8:0x0], updating i_size 4096 00000080:00010000:0.0:1767316903.230745:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x8:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad57021 00000080:00010000:0.0:1767316903.230753:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57021 from it ffffa99f40d87bd0 00010000:00010000:0.0:1767316903.230756:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57021 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad89e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.230764:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57021 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad89e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.230788:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11322d80 x1853163894095104/t4294975961(4294975961) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316903.230892:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d50a.sanity-flr:[0x240000405:0x8:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316903.230901:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0x8:0x0](ffff9cfe0edc21c8),name=d50a.sanity-flr 00000002:00010000:0.0:1767316903.230930:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x8:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.230940:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.230950:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.230956:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.230962:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x8:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316903.230965:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x8:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad57013 00000080:00010000:0.0:1767316903.230969:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57013 from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316903.230972:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.230978:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.231018:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0x8:0x0](ffff9cfe0edc21c8) pos/size0/4096 32bit_api 0 00000080:00200000:0.0:1767316903.231041:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0x8:0x0](ffff9cfe0edc21c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:0.0:1767316903.231062:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x8:0x0](ffff9cfe0edc21c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.231151:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f50a.sanity-flr, dir=[0x240000405:0x8:0x0](ffff9cfe0edc21c8), flags=0 00000080:00200000:0.0:1767316903.231156:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f50a.sanity-flr, dir=[0x240000405:0x8:0x0](ffff9cfe0edc21c8), intent=getattr 00000002:00010000:0.0:1767316903.231171:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f50a.sanity-flr,[0x0:0x0:0x0]) in obj [0x240000405:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.231212:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.231218:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.231227:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.231245:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894095232:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.231488:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.236005:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894095232:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.236038:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad8c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.236062:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad8c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.236070:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad8c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.236138:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad8c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.236166:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad8c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.236190:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad8c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.236199:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad8c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.236206:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad8c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.236217:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11321f80 x1853163894095232/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/1160 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.236228:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 576 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad8c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.236240:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad8c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316903.236250:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/9 (0 0) 00000080:00200000:0.0:1767316903.236256:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000405:0x8:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316903.236289:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000405:0x9:0x0](ffff9cfe0edc00c8) 00000080:00200000:0.0:1767316903.236368:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x9:0x0], updating i_size 3700000 00000080:00200000:0.0:1767316903.236395:0:83725:0:(file.c:6809:ll_layout_conf()) [0x240000405:0x9:0x0]: layout version change: 4294967294 -> 9 00000080:00010000:0.0:1767316903.236401:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x9:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad57028 00000080:00010000:0.0:1767316903.236412:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x9:0x0](ffff9cfe0edc00c8) 00000080:00010000:0.0:1767316903.236421:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57028 from it ffffa99f40d87df8 00010000:00010000:0.0:1767316903.236425:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad8c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316903.236434:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ad8c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316903.236468:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x8:0x0](ffff9cfe0edc21c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767316903.236476:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f50a.sanity-flr, dir=[0x240000405:0x8:0x0](ffff9cfe0edc21c8) 00010000:00010000:0.0:1767316903.236511:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.236600:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ad8c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316903.236612:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x240000405:0x9:0x0]: losing layout lock 00010000:00010000:0.0:1767316903.236643:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad8c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316903.236651:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.236657:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316903.236660:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57028 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad8c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316903.236674:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57013 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad882 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316903.236689:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316903.236696:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11321f80 x1853163894095488/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316903.236728:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894095488:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316903.236835:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.242505:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894095488:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316903.242563:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x240000405:0x9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316903.242584:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000405:0x9:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316903.242588:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316903.242594:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1767316903.242602:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:0.0:1767316903.242630:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x240000405:0x9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316903.242637:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000405:0x9:0x0](ffff9cfe0edc00c8) 00000080:00200008:0.0:1767316903.242728:0:83725:0:(file.c:424:ll_file_release()) START file d50a.sanity-flr:[0x240000405:0x8:0x0](ffff9cfe0edc21c8), flags 704000 00010000:00010000:0.0:1767316903.242752:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57021 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad89e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.242793:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.242809:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.242817:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.242837:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.242845:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.242850:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.242854:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57005 00000080:00010000:0.0:1767316903.242861:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57005 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316903.242865:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.242883:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.242898:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.242921:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=0 00000080:00200000:0.0:1767316903.242925:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316903.242937:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.242978:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.242986:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.242995:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.243013:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894095616:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.243135:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.246659:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894095616:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.246688:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.246704:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 4/1,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.246711:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 4/1,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.246742:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.246752:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.246764:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.246772:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.246778:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.246789:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11323800 x1853163894095616/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.246800:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.246810:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.246832:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.246839:0:83725:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.246855:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.246861:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.246875:0:83725:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000002:00010000:0.0:1767316903.246892:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000405:0x8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.246949:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.246957:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.246965:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.246982:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894095744:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.247065:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00010000:00010000:1.0:1767316903.247253:0:63143:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316903.247261:0:63143:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.247268:0:63143:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037de00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316903.247273:0:63143:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.247280:0:63143:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.247287:0:63143:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.247304:0:63143:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.247333:0:63143:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.247339:0:63143:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316903.247369:0:63143:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 1/0,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.247375:0:63143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5702f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad8f9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.247387:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316903.247396:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316903.247398:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316903.247406:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316903.247419:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894095872:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316903.250747:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894095872:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316903.253703:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894095744:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.253728:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad907 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.253739:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad907 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.253750:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad907 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.253779:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad907 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.253791:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad907 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.253798:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad907 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.253805:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad907 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.253815:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322300 x1853163894095744/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.253839:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad907 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.253852:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/8 (0 0) 00000080:00200000:0.0:1767316903.253873:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316903.253893:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x8:0x0], updating i_size 4096 00000080:00200000:0.0:1767316903.253897:0:83725:0:(namei.c:151:ll_iget()) got inode: [0x240000405:0x8:0x0](ffff9cfe0edc21c8): rc = 0 00000080:00010000:0.0:1767316903.253913:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000405:0x8:0x0](ffff9cfe0edc21c8) for remote lock 0xd9a0da65fad57036 00000080:00010000:0.0:1767316903.253918:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x8:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad5700c 00000080:00010000:0.0:1767316903.253927:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x8:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316903.253931:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5700c from it ffffa99f40d87e00 00010000:00010000:0.0:1767316903.253935:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.253952:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767316903.253966:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad57036 from it ffffa99f40d87e00 00010000:00010000:0.0:1767316903.253969:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad907 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.253976:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad907 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.253994:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.254010:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.254018:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.254027:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.254033:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.254037:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.254040:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57005 00000080:00010000:0.0:1767316903.254043:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57005 from it ffffa99f40d87d88 00010000:00010000:0.0:1767316903.254046:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.254055:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.254073:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316903.254117:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d50a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316903.254138:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.254175:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 1/0,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.254181:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316903.254206:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5700c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad874 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316903.254231:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316903.254247:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894096000:192.168.202.121@tcp:103:rm.0 00010000:00010000:0.0:1767316903.254336:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad907 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.254351:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57021 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad89e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.254378:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe11322d80 x1853163894095104/t4294975961(4294975961) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316903.254388:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316903.254392:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11323800 x1853163894096256/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316903.254406:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894096256:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316903.254433:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.257942:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894096256:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316903.257981:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe11322d80 x1853163894095104/t4294975961(4294975961) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767316903.258059:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad907 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.258069:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57021 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad89e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.258075:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316903.258108:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57036 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad907 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.258122:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57021 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad89e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316903.258142:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316903.258149:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11323800 x1853163894096512/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316903.258170:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894096512:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316903.258523:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1767316903.262655:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:0.0:1767316903.262767:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894096000:192.168.202.121@tcp:103:rm.0 00000100:00100000:3.0:1767316903.262851:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939830912 00000100:00100000:3.0:1767316903.262860:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939830912 00000100:00100000:3.0:1767316903.262919:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10254 00000100:00100000:3.0:1767316903.262929:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939830912:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316903.262945:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.263033:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316903.263040:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939830912:12345-192.168.202.121@tcp:104: Request processed in 113us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316903.263047:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10254 00010000:00010000:1.0:1767316903.263286:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316903.263295:0:59093:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.263304:0:59093:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037d800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316903.263310:0:59093:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.263318:0:59093:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.263326:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.263399:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.263406:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316903.263432:0:59093:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.263439:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57005 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ad858 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.263483:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316903.263485:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316903.263487:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316903.263495:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316903.263510:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894096640:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316903.268304:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894096640:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316903.280953:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894096512:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316903.281206:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000405:0x8:0x0](ffff9cfe0edc21c8) 00000080:00200000:1.0:1767316903.281305:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.281335:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.281410:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.281423:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.281433:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.281457:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894096768:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.282448:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.285556:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894096768:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.285667:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.285681:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.285718:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.285729:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.285738:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.285744:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.285748:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.285756:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558d180 x1853163894096768/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.285766:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.285775:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316903.285780:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.285803:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316903.285807:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5703d 00000080:00010000:1.0:1767316903.285811:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.285813:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5703d from it ffffa99f40d87b58 00010000:00010000:1.0:1767316903.285816:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.285840:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.285876:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.286040:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50A.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316903.286045:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50A.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316903.286073:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50A.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.286554:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.286563:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.286585:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.286608:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894096896:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.286715:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.290772:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894096896:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.290809:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.290847:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.290855:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.290890:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.290997:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.291012:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.291020:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.291026:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.291039:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558d180 x1853163894096896/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.291050:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.291062:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/14 (0 0) 00000080:00200000:1.0:1767316903.291069:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316903.291428:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0xe:0x0](ffff9cfe0ed99988) 00000080:00200000:1.0:1767316903.291439:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0xe:0x0], updating i_size 4096 00000080:00010000:1.0:1767316903.291447:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe:0x0](ffff9cfe0ed99988) for lock 0xd9a0da65fad57044 00000080:00010000:1.0:1767316903.291460:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe:0x0](ffff9cfe0ed99988) 00000080:00010000:1.0:1767316903.291464:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57044 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316903.291474:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.291483:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316903.291530:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d50A.sanity-flr:[0x200000405:0xe:0x0](ffff9cfe0ed99988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316903.291538:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe:0x0](ffff9cfe0ed99988),name=d50A.sanity-flr 00000002:00010000:1.0:1767316903.291565:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0xe:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.291657:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.291669:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.291675:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.291680:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe:0x0](ffff9cfe0ed99988) 00000080:00010000:1.0:1767316903.291683:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe:0x0](ffff9cfe0ed99988) for lock 0xd9a0da65fad57044 00000080:00010000:1.0:1767316903.291687:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57044 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316903.291690:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.291696:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.291755:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.291764:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.291772:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.291789:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.291796:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.291800:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.291802:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5703d 00000080:00010000:1.0:1767316903.291806:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5703d from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316903.291809:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.291816:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.291839:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.291846:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50A.sanity-flr, flags=266 00000080:00200000:1.0:1767316903.291851:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe:0x0](ffff9cfe0ed99988), inode mode 41ed mask 44 00000080:00200008:1.0:1767316903.291859:0:83725:0:(file.c:1001:ll_file_open()) START file d50A.sanity-flr:[0x200000405:0xe:0x0](ffff9cfe0ed99988), flags 704400 00000002:00010000:1.0:1767316903.291875:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0xe:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767316903.292029:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5704b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.292037:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5704b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316903.292049:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316903.292058:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558d180 x1853163894097152/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316903.292068:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5704b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.292131:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894097152:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.292481:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.296730:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894097152:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.296757:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5704b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.296770:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5704b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.296777:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5704b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.296785:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5704b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.296791:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5704b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.296797:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316903.296802:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5704b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.296808:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5704b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.296815:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5704b lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.296833:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316903.296840:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5704b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.296868:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5704b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:1.0:1767316903.296888:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe0558d180 x1853163894097152/t8589937524(8589937524) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316903.296989:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558d180 x1853163894097152/t8589937524(8589937524) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316903.297004:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.297026:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0xe:0x0], updating i_size 4096 00000002:00100000:1.0:1767316903.297047:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558d180 x1853163894097152/t8589937524(8589937524) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316903.297328:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d50A.sanity-flr:[0x200000405:0xe:0x0](ffff9cfe0ed99988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316903.297336:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe:0x0](ffff9cfe0ed99988),name=d50A.sanity-flr 00000002:00010000:1.0:1767316903.297364:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0xe:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.297380:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.297395:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.297403:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.297408:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe:0x0](ffff9cfe0ed99988) 00000080:00010000:1.0:1767316903.297412:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe:0x0](ffff9cfe0ed99988) for lock 0xd9a0da65fad57044 00000080:00010000:1.0:1767316903.297418:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57044 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316903.297422:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.297442:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.297485:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0xe:0x0](ffff9cfe0ed99988) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1767316903.297500:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0xe:0x0]) in obj [0x200000405:0xe:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316903.297506:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.297514:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316903.298677:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894097280:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316903.298787:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.310799:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894097280:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316903.311507:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.311523:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316903.311587:0:83725:0:(file.c:424:ll_file_release()) START file d50A.sanity-flr:[0x200000405:0xe:0x0](ffff9cfe0ed99988), flags 704000 00000002:00100000:1.0:1767316903.311655:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0558d180 x1853163894097152/t8589937524(8589937524) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316903.311667:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316903.311672:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558f100 x1853163894097536/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316903.311712:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894097536:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316903.311804:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.315200:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894097536:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316903.315242:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0558d180 x1853163894097152/t8589937524(8589937524) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316903.315330:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.315351:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.315369:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.315382:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.315391:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.315396:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.315399:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5703d 00000080:00010000:1.0:1767316903.315406:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5703d from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316903.315410:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.315418:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.315432:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.315440:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50A.sanity-flr, flags=266 00000080:00200000:1.0:1767316903.315447:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe:0x0](ffff9cfe0ed99988), inode mode 41ed mask 44 00000080:00200008:1.0:1767316903.315470:0:83725:0:(file.c:1001:ll_file_open()) START file d50A.sanity-flr:[0x200000405:0xe:0x0](ffff9cfe0ed99988), flags 704400 00000002:00010000:1.0:1767316903.315486:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0xe:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767316903.315535:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad57052 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.315544:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad57052 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316903.315556:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316903.315562:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558f100 x1853163894097792/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316903.315651:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad57052 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.315672:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894097792:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.315914:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.320297:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894097792:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.320332:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad57052 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad97e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.320343:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad57052 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad97e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.320354:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad57052 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad97e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.320365:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad57052 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad97e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.320379:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe0558f100 x1853163894097792/t8589937526(8589937526) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316903.320405:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558f100 x1853163894097792/t8589937526(8589937526) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.320417:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad57052 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad97e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.320428:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/14 (0 0) 00000080:00200000:1.0:1767316903.320434:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.320456:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0xe:0x0], updating i_size 4096 00000080:00010000:1.0:1767316903.320461:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe:0x0](ffff9cfe0ed99988) for lock 0xd9a0da65fad57052 00000080:00010000:1.0:1767316903.320469:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57052 from it ffffa99f40d87bd0 00010000:00010000:1.0:1767316903.320473:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad57052 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad97e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.320481:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad57052 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad97e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.320510:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558f100 x1853163894097792/t8589937526(8589937526) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316903.320653:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d50A.sanity-flr:[0x200000405:0xe:0x0](ffff9cfe0ed99988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316903.320663:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe:0x0](ffff9cfe0ed99988),name=d50A.sanity-flr 00000002:00010000:1.0:1767316903.320686:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0xe:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.320696:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.320707:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.320725:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.320731:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe:0x0](ffff9cfe0ed99988) 00000080:00010000:1.0:1767316903.320735:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe:0x0](ffff9cfe0ed99988) for lock 0xd9a0da65fad57044 00000080:00010000:1.0:1767316903.320739:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57044 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316903.320743:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.320750:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.320786:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0xe:0x0](ffff9cfe0ed99988) pos/size0/4096 32bit_api 0 00000080:00200000:1.0:1767316903.320809:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0xe:0x0](ffff9cfe0ed99988) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1767316903.320846:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe:0x0](ffff9cfe0ed99988), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.320863:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f50A.sanity-flr, dir=[0x200000405:0xe:0x0](ffff9cfe0ed99988), flags=0 00000080:00200000:1.0:1767316903.320868:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f50A.sanity-flr, dir=[0x200000405:0xe:0x0](ffff9cfe0ed99988), intent=getattr 00000002:00010000:1.0:1767316903.320880:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f50A.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000405:0xe:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.321027:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.321035:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.321044:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.321065:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894097920:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.321468:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.325385:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894097920:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.325426:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.325450:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.325457:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.325468:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.325479:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.325491:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.325498:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.325505:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.325515:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558d180 x1853163894097920/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/720 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.325526:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.325548:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.325559:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/15 (0 0) 00000080:00200000:1.0:1767316903.325566:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316903.325681:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0xf:0x0](ffff9cfe0ed99148) 00000080:00200000:1.0:1767316903.325755:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0xf:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:1.0:1767316903.325762:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0xf:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad57059 00000080:00010000:1.0:1767316903.325772:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xf:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316903.325775:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57059 from it ffffa99f40d87df8 00010000:00010000:1.0:1767316903.325778:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ad9a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.325786:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ad9a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316903.325831:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe:0x0](ffff9cfe0ed99988), inode mode 41ed mask 3 00000080:00200000:1.0:1767316903.325839:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f50A.sanity-flr, dir=[0x200000405:0xe:0x0](ffff9cfe0ed99988) 00010000:00010000:1.0:1767316903.325873:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.325892:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad57052 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad97e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.326061:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ad9a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316903.326073:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0xf:0x0]: losing layout lock 00010000:00010000:1.0:1767316903.326331:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad9a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.326339:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.326344:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316903.326346:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57059 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ad9a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.326361:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57044 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad962 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316903.326375:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316903.326383:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558d180 x1853163894098176/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316903.326405:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894098176:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316903.326494:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.330974:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894098176:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316903.331034:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0xf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316903.331047:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316903.331310:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0xf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316903.331319:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0xf:0x0](ffff9cfe0ed99148) 00000080:00200008:1.0:1767316903.331406:0:83725:0:(file.c:424:ll_file_release()) START file d50A.sanity-flr:[0x200000405:0xe:0x0](ffff9cfe0ed99988), flags 704000 00010000:00010000:1.0:1767316903.331434:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad57052 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad97e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.331484:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.331505:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.331531:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.331541:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.331548:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.331555:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.331558:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5703d 00000080:00010000:1.0:1767316903.331565:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5703d from it ffffa99f40d87c10 00010000:00010000:1.0:1767316903.331654:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.331664:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.331681:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.331698:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50A.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=0 00000080:00200000:1.0:1767316903.331702:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50A.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316903.331717:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50A.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.331762:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.331769:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.331780:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.331802:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558c380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894098304:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.331990:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acc00 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.335807:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558c380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894098304:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.335866:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9d9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.335883:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9d9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.335890:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9d9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.335912:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9d9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.335924:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9d9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.335936:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9d9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.335944:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9d9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.335952:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9d9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.335963:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558c380 x1853163894098304/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.335975:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9d9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.335998:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/14 (0 0) 00000080:00200000:1.0:1767316903.336005:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316903.336028:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0xe:0x0], updating i_size 4096 00000080:00200000:1.0:1767316903.336031:0:83725:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0xe:0x0](ffff9cfe0ed99988): rc = 0 00000080:00010000:1.0:1767316903.336037:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe:0x0](ffff9cfe0ed99988) for lock 0xd9a0da65fad57060 00000080:00010000:1.0:1767316903.336048:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe:0x0](ffff9cfe0ed99988) 00000080:00010000:1.0:1767316903.336052:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57060 from it ffffa99f40d87e00 00010000:00010000:1.0:1767316903.336055:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9d9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.336064:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9d9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.336142:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.336163:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.336172:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.336193:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.336199:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.336203:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.336206:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5703d 00000080:00010000:1.0:1767316903.336209:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5703d from it ffffa99f40d87d88 00010000:00010000:1.0:1767316903.336212:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.336229:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.336238:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316903.336245:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d50A.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316903.336267:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.336294:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad9d9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.336305:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad57052 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad97e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.336357:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0558f100 x1853163894097792/t8589937526(8589937526) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316903.336369:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316903.336375:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558c380 x1853163894098560/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316903.336396:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558c380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894098560:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316903.336491:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acc00 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.340289:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558c380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894098560:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316903.340327:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0558f100 x1853163894097792/t8589937526(8589937526) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767316903.340411:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad9d9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.340435:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad57052 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad97e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.340443:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.340449:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767316903.340452:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57060 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad9d9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.340464:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad57052 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad97e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.340476:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5703d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad946 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316903.340497:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316903.340504:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558c380 x1853163894098816/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316903.340528:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558c380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894098816:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316903.341550:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acc00 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.345858:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558c380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894098816:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316903.345990:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0xe:0x0](ffff9cfe0ed99988) 00000080:00200000:0.0:1767316903.346358:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.346385:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.346447:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.346458:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.346469:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.346492:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894098944:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.346692:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.350559:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894098944:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.350659:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.350672:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.350684:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.350695:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.350706:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.350714:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.350736:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.350749:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322300 x1853163894098944/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.350764:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.350777:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316903.350784:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316903.350810:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316903.350828:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57067 00000080:00010000:0.0:1767316903.350835:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.350838:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57067 from it ffffa99f40d87b58 00010000:00010000:0.0:1767316903.350841:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.350849:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.350876:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.350897:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316903.351001:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316903.351024:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.351065:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.351156:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.351167:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.351414:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894099072:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.351564:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.355456:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894099072:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.355485:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.355509:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.355517:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.355528:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.355538:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.355550:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.355557:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.355782:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.355794:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322300 x1853163894099072/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.355805:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.355814:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/19 (0 0) 00000080:00200000:0.0:1767316903.355831:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316903.355862:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x13:0x0](ffff9cfe0edc00c8) 00000080:00200000:0.0:1767316903.355869:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x13:0x0], updating i_size 4096 00000080:00010000:0.0:1767316903.355876:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x13:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad5706e 00000080:00010000:0.0:1767316903.355888:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x13:0x0](ffff9cfe0edc00c8) 00000080:00010000:0.0:1767316903.355892:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5706e from it ffffa99f40d87b20 00010000:00010000:0.0:1767316903.355895:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.355998:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316903.356038:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d50b.sanity-flr:[0x200000405:0x13:0x0](ffff9cfe0edc00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316903.356045:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x13:0x0](ffff9cfe0edc00c8),name=d50b.sanity-flr 00000002:00010000:0.0:1767316903.356069:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x13:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.356156:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.356244:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.356253:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.356258:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x13:0x0](ffff9cfe0edc00c8) 00000080:00010000:0.0:1767316903.356261:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x13:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad5706e 00000080:00010000:0.0:1767316903.356266:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5706e from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316903.356269:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.356275:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.356326:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.356334:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.356341:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.356349:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.356355:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.356358:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.356361:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57067 00000080:00010000:0.0:1767316903.356364:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57067 from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316903.356367:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.356382:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.356391:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.356397:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50b.sanity-flr, flags=266 00000080:00200000:0.0:1767316903.356401:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x13:0x0](ffff9cfe0edc00c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767316903.356409:0:83725:0:(file.c:1001:ll_file_open()) START file d50b.sanity-flr:[0x200000405:0x13:0x0](ffff9cfe0edc00c8), flags 704400 00000002:00010000:0.0:1767316903.356422:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x13:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316903.356471:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad57075 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.356478:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad57075 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316903.356489:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316903.356495:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11322300 x1853163894099328/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316903.356504:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad57075 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.356523:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894099328:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.356835:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.361298:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894099328:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.361325:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad57075 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.361339:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad57075 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.361368:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad57075 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.361375:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad57075 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.361382:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad57075 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.361388:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037dc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316903.361393:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad57075 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.361398:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad57075 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.361405:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad57075 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.361411:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316903.361417:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad57075 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.361423:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad57075 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316903.361443:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe11322300 x1853163894099328/t8589937530(8589937530) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316903.361456:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11322300 x1853163894099328/t8589937530(8589937530) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316903.361468:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316903.361494:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x13:0x0], updating i_size 4096 00000002:00100000:0.0:1767316903.361512:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11322300 x1853163894099328/t8589937530(8589937530) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316903.361650:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d50b.sanity-flr:[0x200000405:0x13:0x0](ffff9cfe0edc00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316903.361658:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x13:0x0](ffff9cfe0edc00c8),name=d50b.sanity-flr 00000002:00010000:0.0:1767316903.361682:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x13:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.361696:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.361707:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.361714:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.361718:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x13:0x0](ffff9cfe0edc00c8) 00000080:00010000:0.0:1767316903.361721:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x13:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad5706e 00000080:00010000:0.0:1767316903.361726:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5706e from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316903.361729:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.361736:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.361767:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x13:0x0](ffff9cfe0edc00c8) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767316903.361779:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x13:0x0]) in obj [0x200000405:0x13:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316903.361785:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.361793:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316903.362836:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894099456:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316903.362948:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.376567:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894099456:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316903.377362:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.377382:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.377449:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x13:0x0](ffff9cfe0edc00c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200008:0.0:1767316903.377473:0:83725:0:(file.c:424:ll_file_release()) START file d50b.sanity-flr:[0x200000405:0x13:0x0](ffff9cfe0edc00c8), flags 704000 00000002:00100000:0.0:1767316903.377557:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe11322300 x1853163894099328/t8589937530(8589937530) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316903.377569:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316903.377575:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11322d80 x1853163894099712/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316903.377599:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894099712:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316903.377695:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.383341:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894099712:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316903.383380:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe11322300 x1853163894099328/t8589937530(8589937530) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316903.383445:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.383464:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.383497:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.383510:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.383517:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.383522:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.383525:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57067 00000080:00010000:0.0:1767316903.383531:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57067 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316903.383534:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.383543:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.383557:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.383567:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50b.sanity-flr, flags=0 00000080:00200000:0.0:1767316903.383650:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.383658:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.383665:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.383674:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.383680:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.383684:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.383686:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57067 00000080:00010000:0.0:1767316903.383690:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57067 from it ffffa99f40d87d88 00010000:00010000:0.0:1767316903.383699:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.383707:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.383716:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316903.383722:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d50b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316903.383743:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.383769:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.383873:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 1/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.383880:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.383885:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316903.383888:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad5706e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ada18 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.383989:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad57067 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ad9fc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316903.384010:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316903.384018:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11322d80 x1853163894099968/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316903.384053:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894099968:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316903.385736:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.395838:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894099968:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316903.395890:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x13:0x0](ffff9cfe0edc00c8) 00000080:00200000:0.0:1767316903.395980:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.396004:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.396064:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.396074:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.396134:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.396158:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894100096:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.396245:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.402438:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894100096:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.402471:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.402483:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.402494:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.402504:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.402535:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.402543:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.402550:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.402560:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322300 x1853163894100096/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.402584:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.402597:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316903.402605:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316903.402633:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316903.402639:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5707c 00000080:00010000:0.0:1767316903.402644:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.402647:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5707c from it ffffa99f40d87b58 00010000:00010000:0.0:1767316903.402651:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.402659:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.402682:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.402706:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316903.402710:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316903.402734:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50c.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.402774:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.402780:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.402788:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.402809:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894100224:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.402914:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.410107:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894100224:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.410138:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.410162:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.410171:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.410195:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.410207:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.410242:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.410252:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.410259:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.410270:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322300 x1853163894100224/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/672 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.410286:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.410298:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/23 (0 0) 00000080:00200000:0.0:1767316903.410305:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316903.410349:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x17:0x0](ffff9cfe0edc00c8) 00000002:00010000:0.0:1767316903.410378:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.410424:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.410432:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.410440:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.410460:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894100352:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.410674:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.414989:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894100352:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.415016:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.415026:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.415038:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.415048:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.415061:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.415068:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.415075:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.415109:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322a00 x1853163894100352/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.415123:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.415136:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589937616/1 (0 0) 00010000:00010000:0.0:1767316903.415144:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.415166:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.415263:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x1:0x0]) in obj [0x240000406:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.415322:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.415329:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.415338:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.415358:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894100480:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.415485:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.419552:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894100480:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.419589:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 4/1,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.419602:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 4/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.419619:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.419633:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.419647:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.419680:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.419691:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.419707:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322a00 x1853163894100480/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.419723:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.419742:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677446/1 (0 0) 00010000:00010000:0.0:1767316903.419755:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.419764:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.419808:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x17:0x0], updating i_size 8192 00000080:00010000:0.0:1767316903.419830:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x17:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad57083 00000080:00010000:0.0:1767316903.419848:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x17:0x0](ffff9cfe0edc00c8) 00000080:00010000:0.0:1767316903.419853:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57083 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316903.419857:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.419870:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316903.420061:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d50c.sanity-flr:[0x200000405:0x17:0x0](ffff9cfe0edc00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316903.420068:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x17:0x0](ffff9cfe0edc00c8),name=d50c.sanity-flr 00000002:00010000:0.0:1767316903.420120:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x17:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.420129:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420144:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.420158:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.420164:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420174:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420238:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420249:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.420264:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x1:0x0]) in obj [0x240000406:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.420270:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420283:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420309:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420319:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.420331:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316903.420339:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x17:0x0](ffff9cfe0edc00c8) 00000080:00010000:0.0:1767316903.420345:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x17:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad57083 00000080:00010000:0.0:1767316903.420349:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57083 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316903.420352:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420361:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.420375:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.420386:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420393:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420403:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420562:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.420661:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x1:0x0]) in obj [0x240000406:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.420668:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420681:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420689:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420701:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.420767:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.420782:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.420789:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420802:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.420809:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.420815:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.420827:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5707c 00000080:00010000:0.0:1767316903.420834:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5707c from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316903.420837:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.420860:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.420874:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.420880:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50c.sanity-flr, flags=266 00000080:00200000:0.0:1767316903.420889:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x17:0x0](ffff9cfe0edc00c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767316903.420988:0:83725:0:(file.c:1001:ll_file_open()) START file d50c.sanity-flr:[0x200000405:0x17:0x0](ffff9cfe0edc00c8), flags 704400 00000002:00010000:0.0:1767316903.421014:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x17:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316903.421073:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57098 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.421393:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57098 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316903.421649:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316903.421662:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11322300 x1853163894100736/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316903.421672:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57098 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.421694:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894100736:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.422064:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.430134:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894100736:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.430159:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57098 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.430172:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57098 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.430198:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57098 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.430205:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57098 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.430212:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57098 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.430218:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037d800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316903.430222:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57098 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.430229:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57098 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.430236:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57098 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.430243:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316903.430250:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57098 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.430255:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad57098 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316903.430274:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe11322300 x1853163894100736/t8589937533(8589937533) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316903.430286:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11322300 x1853163894100736/t8589937533(8589937533) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316903.430301:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316903.430337:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x17:0x0], updating i_size 4096 00000002:00100000:0.0:1767316903.430356:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11322300 x1853163894100736/t8589937533(8589937533) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316903.430424:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d50c.sanity-flr:[0x200000405:0x17:0x0](ffff9cfe0edc00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316903.430432:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x17:0x0](ffff9cfe0edc00c8),name=d50c.sanity-flr 00000002:00010000:0.0:1767316903.430454:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x17:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.430469:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.430480:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.430489:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.430496:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.430502:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.430511:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.430519:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.430533:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x1:0x0]) in obj [0x240000406:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.430541:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.430559:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.430578:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.430586:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.430595:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316903.430600:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x17:0x0](ffff9cfe0edc00c8) 00000080:00010000:0.0:1767316903.430604:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x17:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad57083 00000080:00010000:0.0:1767316903.430608:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57083 from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316903.430611:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.430617:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.430628:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.430634:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.430642:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.430649:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.430666:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.430675:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x1:0x0]) in obj [0x240000406:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.430680:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.430688:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.430695:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.430702:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.430730:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x17:0x0](ffff9cfe0edc00c8) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767316903.430742:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.430767:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316903.430774:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.430781:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316903.431457:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894100864:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316903.431563:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.445283:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894100864:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316903.445976:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.445993:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.446022:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x1:0x0]) in obj [0x240000406:0x1:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316903.446039:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.446051:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316903.446693:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894100992:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316903.446872:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.458705:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894100992:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316903.459828:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.459845:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316903.461892:0:83725:0:(file.c:424:ll_file_release()) START file d50c.sanity-flr:[0x200000405:0x17:0x0](ffff9cfe0edc00c8), flags 704000 00000002:00100000:1.0:1767316903.462277:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe11322300 x1853163894100736/t8589937533(8589937533) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316903.462291:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316903.462297:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558f100 x1853163894101248/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316903.462339:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894101248:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316903.462562:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.471794:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894101248:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316903.471843:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe11322300 x1853163894100736/t8589937533(8589937533) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316903.471935:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.471956:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.471973:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.471986:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.471994:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.472000:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.472003:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5707c 00000080:00010000:1.0:1767316903.472010:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5707c from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316903.472014:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.472022:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.472038:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.472060:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50c.sanity-flr, flags=266 00000080:00200000:1.0:1767316903.472069:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x17:0x0](ffff9cfe0edc00c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767316903.472159:0:83725:0:(file.c:1001:ll_file_open()) START file d50c.sanity-flr:[0x200000405:0x17:0x0](ffff9cfe0edc00c8), flags 704400 00000002:00010000:1.0:1767316903.472176:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x17:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767316903.472227:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5709f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.472235:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5709f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316903.472246:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316903.472253:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558f100 x1853163894101504/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316903.472262:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5709f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.472284:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894101504:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.474582:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.479774:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894101504:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.479811:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5709f lrc: 4/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada9d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.479832:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5709f lrc: 4/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada9d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.479844:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5709f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada9d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.479856:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5709f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada9d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.479871:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe0558f100 x1853163894101504/t8589937535(8589937535) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316903.479903:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558f100 x1853163894101504/t8589937535(8589937535) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.479919:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5709f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada9d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.479930:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/23 (0 0) 00000080:00200000:1.0:1767316903.479937:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.479973:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x17:0x0], updating i_size 4096 00000080:00010000:1.0:1767316903.479980:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x17:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad5709f 00000080:00010000:1.0:1767316903.479989:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5709f from it ffffa99f40d87bd0 00010000:00010000:1.0:1767316903.479993:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5709f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada9d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480002:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5709f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada9d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.480028:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558f100 x1853163894101504/t8589937535(8589937535) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316903.480143:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d50c.sanity-flr:[0x200000405:0x17:0x0](ffff9cfe0edc00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316903.480151:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x17:0x0](ffff9cfe0edc00c8),name=d50c.sanity-flr 00000002:00010000:1.0:1767316903.480173:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x17:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.480182:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480193:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.480212:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.480219:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480227:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480234:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480240:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.480250:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x1:0x0]) in obj [0x240000406:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.480255:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480262:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480269:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480275:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.480284:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316903.480289:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x17:0x0](ffff9cfe0edc00c8) 00000080:00010000:1.0:1767316903.480293:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x17:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad57083 00000080:00010000:1.0:1767316903.480302:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57083 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316903.480305:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480312:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.480324:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.480329:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480337:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480344:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480351:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.480358:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x1:0x0]) in obj [0x240000406:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.480362:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480368:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480374:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480390:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.480438:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x17:0x0](ffff9cfe0edc00c8) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767316903.480451:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.480473:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x1:0x0]) in obj [0x200000bd0:0x1:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316903.480479:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480485:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767316903.480496:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767316903.480499:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480505:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.480514:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x1:0x0]) in obj [0x240000406:0x1:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316903.480518:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480524:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767316903.480533:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767316903.480544:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.480551:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.480588:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x17:0x0](ffff9cfe0edc00c8) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:1.0:1767316903.480610:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x17:0x0](ffff9cfe0edc00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.480626:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f50c.sanity-flr, dir=[0x200000405:0x17:0x0](ffff9cfe0edc00c8), flags=0 00000080:00200000:1.0:1767316903.480630:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f50c.sanity-flr, dir=[0x200000405:0x17:0x0](ffff9cfe0edc00c8), intent=getattr 00000002:00010000:1.0:1767316903.480644:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f50c.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.480682:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.480689:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.480698:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.480720:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894101632:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.480815:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.487042:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894101632:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.487070:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adac0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.487133:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adac0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.487140:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adac0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.487165:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adac0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.487175:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adac0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.487187:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adac0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.487195:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adac0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.487201:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adac0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.487211:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558ea00 x1853163894101632/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/872 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.487221:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 288 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adac0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.487234:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adac0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.487244:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/24 (0 0) 00000080:00200000:1.0:1767316903.487251:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316903.487288:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x18:0x0](ffff9cfe0ed99148) 00000080:00200000:1.0:1767316903.487375:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x18:0x0]: layout version change: 4294967294 -> 6 00000080:00010000:1.0:1767316903.487382:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x18:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad570a6 00000080:00010000:1.0:1767316903.487396:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x18:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316903.487399:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570a6 from it ffffa99f40d87df8 00010000:00010000:1.0:1767316903.487403:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655adac0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.487411:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655adac0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316903.487448:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x17:0x0](ffff9cfe0edc00c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767316903.487457:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f50c.sanity-flr, dir=[0x200000405:0x17:0x0](ffff9cfe0edc00c8) 00010000:00010000:1.0:1767316903.487492:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.487549:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655adac0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316903.487561:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x18:0x0]: losing layout lock 00010000:00010000:1.0:1767316903.487591:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655adac0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.487598:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.487604:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316903.487607:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570a6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655adac0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.487623:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5708a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ada73 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316903.487639:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316903.487652:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558ea00 x1853163894101888/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316903.487674:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894101888:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316903.487760:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.490718:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ea00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894101888:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316903.490783:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x18:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316903.490796:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x18:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316903.490799:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316903.490806:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316903.490855:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x18:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316903.490863:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x18:0x0](ffff9cfe0ed99148) 00000080:00200008:1.0:1767316903.490973:0:83725:0:(file.c:424:ll_file_release()) START file d50c.sanity-flr:[0x200000405:0x17:0x0](ffff9cfe0edc00c8), flags 704000 00010000:00010000:1.0:1767316903.491001:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5709f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada9d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.491040:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.491056:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.491066:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.491075:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.491130:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.491136:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.491140:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5707c 00000080:00010000:1.0:1767316903.491147:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5707c from it ffffa99f40d87c10 00010000:00010000:1.0:1767316903.491168:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.491176:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.491191:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.491201:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50c.sanity-flr, flags=0 00000080:00200000:1.0:1767316903.491207:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.491214:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.491221:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.491228:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.491234:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.491238:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.491241:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5707c 00000080:00010000:1.0:1767316903.491244:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5707c from it ffffa99f40d87d88 00010000:00010000:1.0:1767316903.491247:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.491254:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.491262:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316903.491268:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d50c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316903.491290:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.491325:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5709f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ada9d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.491369:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0558f100 x1853163894101504/t8589937535(8589937535) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316903.491381:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316903.491387:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558ca80 x1853163894102144/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316903.491409:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ca80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894102144:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316903.491508:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.495394:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ca80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894102144:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316903.495435:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0558f100 x1853163894101504/t8589937535(8589937535) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767316903.495488:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.495533:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5709f lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ada9d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.495541:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.495549:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.495555:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767316903.495583:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5709f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ada9d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.495596:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57083 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ada65 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.495612:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad5707c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ada49 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316903.495632:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316903.495638:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558ca80 x1853163894102400/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316903.495660:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ca80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894102400:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316903.495742:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1767316903.499738:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316903.499854:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939832832 00000100:00100000:2.0:1767316903.499866:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939832832 00000100:00100000:2.0:1767316903.499932:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10255 00000100:00100000:2.0:1767316903.499943:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:16197:x1853163939832832:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316903.499963:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.500045:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316903.500052:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:16197:x1853163939832832:12345-192.168.202.121@tcp:104: Request processed in 112us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316903.500060:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10255 00010000:00010000:0.0:1767316903.500176:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316903.500194:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.500229:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c600 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316903.500234:0:42049:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.500243:0:42049:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.500252:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.500373:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 2/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.500381:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316903.500410:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 1/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.500418:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57091 lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ada81 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.500436:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316903.500438:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316903.500440:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316903.500448:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316903.500464:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894102528:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316903.508449:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894102528:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316903.520158:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ca80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894102400:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316903.520418:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x17:0x0](ffff9cfe0edc00c8) 00000080:00200000:0.0:1767316903.520529:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.520552:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.520622:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.520633:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.520643:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.520664:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894102656:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.520777:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.528238:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894102656:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.528265:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.528278:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.528289:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.528302:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.528313:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.528320:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.528343:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.528356:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322a00 x1853163894102656/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.528369:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.528382:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316903.528389:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316903.528419:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316903.528425:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad570ad 00000080:00010000:0.0:1767316903.528430:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.528433:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570ad from it ffffa99f40d87b58 00010000:00010000:0.0:1767316903.528437:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.528445:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.528473:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.528494:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316903.528499:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316903.528525:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.528584:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.528603:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.528614:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.528635:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894102784:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.528734:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.532151:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894102784:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.532192:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.532219:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 4/1,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.532227:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 4/1,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.532239:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.532250:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.532263:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.532271:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.532296:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.532308:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322a00 x1853163894102784/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.532321:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.532332:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 9663677445/13 (0 0) 00000002:00010000:0.0:1767316903.532348:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000405:0xd:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.532394:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 3/1,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.532401:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 3/1,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.532409:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 3/1,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.532430:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894102912:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.532504:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.538459:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894102912:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.538485:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 4/1,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.538499:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 4/1,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.538529:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.538540:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.538552:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.538560:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.538579:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.538591:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11320e00 x1853163894102912/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.538603:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.538616:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/13 (0 0) 00000080:00200000:0.0:1767316903.538640:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316903.538748:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000405:0xd:0x0](ffff9cfe0edc00c8) 00000080:00200000:0.0:1767316903.538758:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0xd:0x0], updating i_size 4096 00000080:00010000:0.0:1767316903.538766:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000405:0xd:0x0](ffff9cfe0edc00c8) for remote lock 0xd9a0da65fad570bb 00000080:00010000:0.0:1767316903.538772:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0xd:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad570b4 00000080:00010000:0.0:1767316903.538784:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0xd:0x0](ffff9cfe0edc00c8) 00000080:00010000:0.0:1767316903.538794:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570b4 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316903.538798:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.538806:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767316903.538832:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad570bb from it ffffa99f40d87b20 00010000:00010000:0.0:1767316903.538836:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.538844:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316903.538877:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d50d.sanity-flr:[0x240000405:0xd:0x0](ffff9cfe0edc00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316903.538885:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0xd:0x0](ffff9cfe0edc00c8),name=d50d.sanity-flr 00000002:00010000:0.0:1767316903.538926:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xd:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.538935:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.538946:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.538952:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.538956:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0xd:0x0](ffff9cfe0edc00c8) 00000080:00010000:0.0:1767316903.538959:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0xd:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad570bb 00000080:00010000:0.0:1767316903.538963:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570bb from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316903.538966:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.538982:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.539042:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.539052:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.539059:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.539067:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.539073:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.539077:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.539370:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad570ad 00000080:00010000:0.0:1767316903.539376:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570ad from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316903.539380:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.539388:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.539396:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.539404:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50d.sanity-flr, flags=266 00000080:00200000:0.0:1767316903.539410:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0xd:0x0](ffff9cfe0edc00c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767316903.539419:0:83725:0:(file.c:1001:ll_file_open()) START file d50d.sanity-flr:[0x240000405:0xd:0x0](ffff9cfe0edc00c8), flags 704400 00000002:00010000:0.0:1767316903.539436:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xd:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316903.539490:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.539503:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316903.539522:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316903.539530:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11320e00 x1853163894103168/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316903.539539:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.539560:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894103168:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.539914:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.544575:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894103168:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.544603:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.544615:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.544622:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.544629:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.544636:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c2 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.544643:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316903.544648:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c2 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.544672:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c2 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.544680:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c2 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.544688:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316903.544696:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.544703:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316903.544733:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe11320e00 x1853163894103168/t4294975968(4294975968) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316903.544746:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11320e00 x1853163894103168/t4294975968(4294975968) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316903.544759:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316903.544781:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0xd:0x0], updating i_size 4096 00000002:00100000:0.0:1767316903.544800:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11320e00 x1853163894103168/t4294975968(4294975968) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316903.544876:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d50d.sanity-flr:[0x240000405:0xd:0x0](ffff9cfe0edc00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316903.544883:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0xd:0x0](ffff9cfe0edc00c8),name=d50d.sanity-flr 00000002:00010000:0.0:1767316903.545068:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xd:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.545129:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.545142:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.545159:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.545165:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0xd:0x0](ffff9cfe0edc00c8) 00000080:00010000:0.0:1767316903.545169:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0xd:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad570bb 00000080:00010000:0.0:1767316903.545174:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570bb from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316903.545177:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.545370:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.545414:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0xd:0x0](ffff9cfe0edc00c8) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767316903.545431:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xd:0x0]) in obj [0x240000405:0xd:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316903.545439:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.545447:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316903.546365:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894103296:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316903.546478:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.553585:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894103296:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316903.554434:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.554451:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316903.554533:0:83725:0:(file.c:424:ll_file_release()) START file d50d.sanity-flr:[0x240000405:0xd:0x0](ffff9cfe0edc00c8), flags 704000 00000002:00100000:0.0:1767316903.554608:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe11320e00 x1853163894103168/t4294975968(4294975968) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316903.554621:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316903.554627:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11322a00 x1853163894103552/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316903.554654:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894103552:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316903.554746:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.563999:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894103552:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316903.564036:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe11320e00 x1853163894103168/t4294975968(4294975968) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316903.564171:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.564193:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.564210:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.564223:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.564230:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.564235:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.564239:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad570ad 00000080:00010000:0.0:1767316903.564245:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570ad from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316903.564249:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.564270:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.564285:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.564292:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d50d.sanity-flr, flags=266 00000080:00200000:0.0:1767316903.564299:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0xd:0x0](ffff9cfe0edc00c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767316903.564307:0:83725:0:(file.c:1001:ll_file_open()) START file d50d.sanity-flr:[0x240000405:0xd:0x0](ffff9cfe0edc00c8), flags 704400 00000002:00010000:0.0:1767316903.564323:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xd:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1767316903.564379:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.564388:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316903.564399:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316903.564405:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11322a00 x1853163894103808/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316903.564415:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.564434:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894103808:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.564636:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.571197:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894103808:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.571245:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c9 lrc: 4/1,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb5a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.571256:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c9 lrc: 4/1,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb5a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.571284:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb5a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.571295:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb5a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.571311:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe11322a00 x1853163894103808/t4294975970(4294975970) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316903.571323:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11322a00 x1853163894103808/t4294975970(4294975970) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.571334:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb5a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.571344:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 16 res 9663677445/13 (0 0) 00000080:00200000:0.0:1767316903.571351:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316903.571371:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0xd:0x0], updating i_size 4096 00000080:00010000:0.0:1767316903.571376:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0xd:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad570c9 00000080:00010000:0.0:1767316903.571384:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570c9 from it ffffa99f40d87bd0 00010000:00010000:0.0:1767316903.571388:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb5a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.571397:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c9 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb5a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.571424:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11322a00 x1853163894103808/t4294975970(4294975970) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316903.571503:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d50d.sanity-flr:[0x240000405:0xd:0x0](ffff9cfe0edc00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316903.571511:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0xd:0x0](ffff9cfe0edc00c8),name=d50d.sanity-flr 00000002:00010000:0.0:1767316903.571534:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0xd:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.571544:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.571557:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.571564:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.571576:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0xd:0x0](ffff9cfe0edc00c8) 00000080:00010000:0.0:1767316903.571580:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0xd:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad570bb 00000080:00010000:0.0:1767316903.571584:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570bb from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316903.571587:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.571593:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.571626:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0xd:0x0](ffff9cfe0edc00c8) pos/size0/4096 32bit_api 0 00000080:00200000:0.0:1767316903.571649:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0xd:0x0](ffff9cfe0edc00c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:0.0:1767316903.571671:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0xd:0x0](ffff9cfe0edc00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.571687:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f50d.sanity-flr, dir=[0x240000405:0xd:0x0](ffff9cfe0edc00c8), flags=0 00000080:00200000:0.0:1767316903.571691:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f50d.sanity-flr, dir=[0x240000405:0xd:0x0](ffff9cfe0edc00c8), intent=getattr 00000002:00010000:0.0:1767316903.571703:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f50d.sanity-flr,[0x0:0x0:0x0]) in obj [0x240000405:0xd:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.571747:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.571763:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.571773:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.571793:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894103936:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.571900:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.581511:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894103936:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.581540:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 4/1,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb7d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.581563:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 4/1,0 mode: --/PR res: [0x240000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb7d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.581578:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 4/1,0 mode: --/PR res: [0x240000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb7d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.581590:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb7d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.581601:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb7d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.581613:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb7d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.581621:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb7d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.581649:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb7d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.581662:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11320e00 x1853163894103936/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/1032 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.581674:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 448 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb7d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.581687:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb7d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316903.581698:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/14 (0 0) 00000080:00200000:0.0:1767316903.581705:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000405:0xd:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316903.581740:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000405:0xe:0x0](ffff9cfe0edc3248) 00000080:00200000:0.0:1767316903.581829:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0xe:0x0], updating i_size 1065984 00000080:00200000:0.0:1767316903.581859:0:83725:0:(file.c:6809:ll_layout_conf()) [0x240000405:0xe:0x0]: layout version change: 4294967294 -> 9 00000080:00010000:0.0:1767316903.581866:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0xe:0x0](ffff9cfe0edc3248) for lock 0xd9a0da65fad570d0 00000080:00010000:0.0:1767316903.581876:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0xe:0x0](ffff9cfe0edc3248) 00000080:00010000:0.0:1767316903.581879:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570d0 from it ffffa99f40d87df8 00010000:00010000:0.0:1767316903.581883:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655adb7d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316903.581891:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655adb7d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316903.581934:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0xd:0x0](ffff9cfe0edc00c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767316903.581943:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f50d.sanity-flr, dir=[0x240000405:0xd:0x0](ffff9cfe0edc00c8) 00010000:00010000:0.0:1767316903.581996:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.582075:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655adb7d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316903.582141:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x240000405:0xe:0x0]: losing layout lock 00010000:00010000:0.0:1767316903.582175:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 1/0,0 mode: --/PR res: [0x240000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655adb7d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316903.582195:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 1/0,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.582201:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316903.582204:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad570d0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655adb7d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316903.582218:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad570bb lrc: 0/0,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adb3e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316903.582233:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316903.582240:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11320e00 x1853163894104192/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316903.582261:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894104192:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316903.582350:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.587047:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894104192:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316903.587131:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x240000405:0xe:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316903.587144:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000405:0xe:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316903.587147:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316903.587169:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00020000:00200000:0.0:1767316903.587195:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[3] flags 0x10 00000080:00200000:0.0:1767316903.587222:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x240000405:0xe:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316903.587230:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000405:0xe:0x0](ffff9cfe0edc3248) 00000080:00200008:0.0:1767316903.587328:0:83725:0:(file.c:424:ll_file_release()) START file d50d.sanity-flr:[0x240000405:0xd:0x0](ffff9cfe0edc00c8), flags 704000 00010000:00010000:0.0:1767316903.587353:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c9 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0xd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb5a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.587397:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.587414:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.587423:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.587432:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.587439:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.587445:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.587448:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad570ad 00000080:00010000:0.0:1767316903.587455:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570ad from it ffffa99f40d87c10 00010000:00010000:0.0:1767316903.587458:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.587465:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.587479:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.587493:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d50d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=0 00000080:00200000:0.0:1767316903.587497:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d50d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316903.587511:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d50d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.587557:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.587565:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.587862:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.587886:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894104320:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.588152:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.601486:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894104320:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.601516:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.601535:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 4/1,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.601542:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 4/1,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.601553:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.601563:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.602001:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.602010:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.602034:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.602046:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11321880 x1853163894104320/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.602059:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.602070:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.602763:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.602777:0:83725:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.602784:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.602791:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.604038:0:83725:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000002:00010000:1.0:1767316903.604068:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000405:0xd:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.604152:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 3/1,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.604164:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 3/1,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.604174:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 3/1,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.604210:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894104448:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.604300:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.607168:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894104448:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.607204:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 4/1,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adbc3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.607216:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 4/1,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adbc3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.607228:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adbc3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.607239:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adbc3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.607251:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adbc3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.607259:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 5/2,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adbc3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.607266:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 4/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adbc3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.607277:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558f100 x1853163894104448/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.607288:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adbc3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.607300:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/13 (0 0) 00000080:00200000:1.0:1767316903.607323:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316903.607345:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0xd:0x0], updating i_size 4096 00000080:00200000:1.0:1767316903.607354:0:83725:0:(namei.c:151:ll_iget()) got inode: [0x240000405:0xd:0x0](ffff9cfe0edc00c8): rc = 0 00000080:00010000:1.0:1767316903.607360:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000405:0xd:0x0](ffff9cfe0edc00c8) for remote lock 0xd9a0da65fad570de 00000080:00010000:1.0:1767316903.607366:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0xd:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad570b4 00000080:00010000:1.0:1767316903.607377:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0xd:0x0](ffff9cfe0edc00c8) 00000080:00010000:1.0:1767316903.607381:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570b4 from it ffffa99f40d87e00 00010000:00010000:1.0:1767316903.607384:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.607394:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767316903.607407:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad570de from it ffffa99f40d87e00 00010000:00010000:1.0:1767316903.607411:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adbc3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.607418:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adbc3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.607445:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.607465:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.607475:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.607485:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.607491:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.607495:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.607499:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad570ad 00000080:00010000:1.0:1767316903.607509:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570ad from it ffffa99f40d87d88 00010000:00010000:1.0:1767316903.607512:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.607518:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.607527:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316903.607536:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d50d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316903.607558:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.607658:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.607692:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.607700:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 1/0,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.607706:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316903.607731:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad570b4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adb30 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316903.607759:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316903.607778:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894104576:192.168.202.121@tcp:103:rm.0 00010000:00010000:1.0:1767316903.607892:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adbc3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.608558:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c9 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adb5a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.610478:0:63840:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316903.610492:0:63840:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 1/0,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.610502:0:63840:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037d400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316903.610518:0:63840:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 1/0,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.610525:0:63840:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 1/0,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.610532:0:63840:0:(ldlm_request.c:1630:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:0.0:1767316903.610535:0:63840:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 1/0,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.610541:0:63840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad570d7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adbb5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.610562:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316903.610574:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316903.610577:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316903.610647:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894104576:192.168.202.121@tcp:103:rm.0 00000002:00100000:1.0:1767316903.610863:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe11322a00 x1853163894103808/t4294975970(4294975970) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316903.610876:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316903.610882:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558f800 x1853163894104832/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316903.611125:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894104832:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316903.611353:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.620617:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894104832:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316903.620655:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe11322a00 x1853163894103808/t4294975970(4294975970) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767316903.620729:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 1/0,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adbc3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.620738:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c9 lrc: 1/0,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adb5a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.620744:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316903.620747:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570de lrc: 0/0,0 mode: --/PR res: [0x240000405:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adbc3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.620758:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad570c9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0xd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adb5a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316903.620802:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316903.620809:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558f800 x1853163894105088/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316903.620843:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894105088:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316903.621076:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316903.624423:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316903.624516:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939833856 00000100:00100000:3.0:1767316903.624526:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939833856 00000100:00100000:3.0:1767316903.624591:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10256 00000100:00100000:3.0:1767316903.624602:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939833856:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316903.624621:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.624731:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316903.624738:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939833856:12345-192.168.202.121@tcp:104: Request processed in 139us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316903.624746:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10256 00010000:00010000:0.0:1767316903.624807:0:42048:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316903.624825:0:42048:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.624835:0:42048:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c600 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316903.624841:0:42048:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.624849:0:42048:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.624858:0:42048:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.624937:0:42048:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.624944:0:42048:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316903.624978:0:42048:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.624985:0:42048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad570ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655adb14 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.625006:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316903.625008:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316903.625010:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316903.625018:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316903.625036:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894105216:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316903.631298:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894105216:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316903.640353:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894105088:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316903.640406:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000405:0xd:0x0](ffff9cfe0edc00c8) 00000080:00200000:1.0:1767316903.640480:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.640507:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.640579:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.640589:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.640600:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.640623:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894105344:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.640715:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.645163:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894105344:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.645199:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.645211:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.645243:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.645254:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.645267:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.645276:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.645283:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.645294:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558c000 x1853163894105344/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.645307:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.645319:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316903.645325:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.645354:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316903.645361:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad570e5 00000080:00010000:1.0:1767316903.645367:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.645370:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570e5 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316903.645374:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.645388:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.645418:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.645443:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d60a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316903.645448:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d60a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316903.645473:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d60a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.645515:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.645522:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.645531:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.645550:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894105472:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.645649:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.655045:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894105472:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.655120:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.655145:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.655154:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.655191:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.655202:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.655215:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.655223:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.655231:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.655242:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558c000 x1853163894105472/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.655255:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.655266:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/27 (0 0) 00000080:00200000:1.0:1767316903.655273:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316903.655305:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x1b:0x0](ffff9cfe0ed99148) 00000080:00200000:1.0:1767316903.655313:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x1b:0x0], updating i_size 4096 00000080:00010000:1.0:1767316903.655320:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1b:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad570ec 00000080:00010000:1.0:1767316903.655332:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1b:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316903.655335:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570ec from it ffffa99f40d87b20 00010000:00010000:1.0:1767316903.655345:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.655353:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316903.655397:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d60a.sanity-flr:[0x200000405:0x1b:0x0](ffff9cfe0ed99148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316903.655404:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x1b:0x0](ffff9cfe0ed99148),name=d60a.sanity-flr 00000002:00010000:1.0:1767316903.655427:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1b:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.655436:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.655447:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.655454:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.655459:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1b:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316903.655462:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1b:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad570ec 00000080:00010000:1.0:1767316903.655466:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570ec from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316903.655469:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.655476:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.655531:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.655540:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.655548:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.655645:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.655653:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.655658:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.655660:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad570e5 00000080:00010000:1.0:1767316903.655664:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570e5 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316903.655667:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.655675:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.655683:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.655690:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d60a.sanity-flr, flags=266 00000080:00200000:1.0:1767316903.655695:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x1b:0x0](ffff9cfe0ed99148), inode mode 41ed mask 44 00000080:00200008:1.0:1767316903.655704:0:83725:0:(file.c:1001:ll_file_open()) START file d60a.sanity-flr:[0x200000405:0x1b:0x0](ffff9cfe0ed99148), flags 704400 00000002:00010000:1.0:1767316903.655719:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1b:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767316903.655766:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad570f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.655773:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad570f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316903.655784:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316903.655791:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558c000 x1853163894105728/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316903.655800:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad570f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.655837:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894105728:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.656014:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.659438:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894105728:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.659462:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad570f3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.659475:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad570f3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.659482:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad570f3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.659489:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad570f3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.659496:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad570f3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.659502:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2ca00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316903.659507:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad570f3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.659512:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad570f3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.659519:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad570f3 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.659525:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316903.659531:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad570f3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.659558:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad570f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:1.0:1767316903.659590:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe0558c000 x1853163894105728/t8589937540(8589937540) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316903.659603:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558c000 x1853163894105728/t8589937540(8589937540) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316903.659616:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.659636:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x1b:0x0], updating i_size 4096 00000002:00100000:1.0:1767316903.659655:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558c000 x1853163894105728/t8589937540(8589937540) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316903.659720:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d60a.sanity-flr:[0x200000405:0x1b:0x0](ffff9cfe0ed99148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316903.659727:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x1b:0x0](ffff9cfe0ed99148),name=d60a.sanity-flr 00000002:00010000:1.0:1767316903.659748:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1b:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.659761:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.659774:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.659782:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.659787:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1b:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316903.659791:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1b:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad570ec 00000080:00010000:1.0:1767316903.659796:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570ec from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316903.659799:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.659832:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.659865:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x1b:0x0](ffff9cfe0ed99148) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1767316903.659880:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1b:0x0]) in obj [0x200000405:0x1b:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316903.659887:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.659908:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316903.664452:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894105856:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316903.664589:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1767316903.673494:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894105856:192.168.202.121@tcp:37:rm.0 00010000:00010000:3.0:1767316903.674487:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.674505:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1767316903.674567:0:83725:0:(file.c:424:ll_file_release()) START file d60a.sanity-flr:[0x200000405:0x1b:0x0](ffff9cfe0ed99148), flags 704000 00000002:00100000:3.0:1767316903.674636:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0558c000 x1853163894105728/t8589937540(8589937540) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767316903.674649:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767316903.674655:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18fd7100 x1853163894106112/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767316903.674679:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894106112:192.168.202.121@tcp:35:rm.0 00000100:00100000:3.0:1767316903.674782:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0918d780 going to sleep for 11 seconds 00000100:00100000:3.0:1767316903.678124:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894106112:192.168.202.121@tcp:35:rm.0 00000002:00100000:3.0:1767316903.678165:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0558c000 x1853163894105728/t8589937540(8589937540) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767316903.678258:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:3.0:1767316903.678279:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316903.678315:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.678328:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316903.678337:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316903.678343:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:3.0:1767316903.678347:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad570e5 00000080:00010000:3.0:1767316903.678354:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570e5 from it ffffa99f40d87bf8 00010000:00010000:3.0:1767316903.678358:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.678366:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316903.678382:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:3.0:1767316903.678390:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d60a.sanity-flr, flags=266 00000080:00200000:3.0:1767316903.678397:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x1b:0x0](ffff9cfe0ed99148), inode mode 41ed mask 44 00000080:00200008:3.0:1767316903.678405:0:83725:0:(file.c:1001:ll_file_open()) START file d60a.sanity-flr:[0x200000405:0x1b:0x0](ffff9cfe0ed99148), flags 704400 00000002:00010000:3.0:1767316903.678421:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1b:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:3.0:1767316903.678470:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713400/0xd9a0da65fad570fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316903.678477:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713400/0xd9a0da65fad570fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:3.0:1767316903.678489:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767316903.678496:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18fd7100 x1853163894106368/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767316903.678517:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713400/0xd9a0da65fad570fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:3.0:1767316903.678538:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894106368:192.168.202.121@tcp:101:rm.0 00000100:00100000:3.0:1767316903.678734:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0918d780 going to sleep for 11 seconds 00000100:00100000:3.0:1767316903.684012:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894106368:192.168.202.121@tcp:101:rm.0 00010000:00010000:3.0:1767316903.684051:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713400/0xd9a0da65fad570fa lrc: 4/1,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc3a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.684063:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713400/0xd9a0da65fad570fa lrc: 4/1,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc3a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.684075:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713400/0xd9a0da65fad570fa lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc3a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.684124:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713400/0xd9a0da65fad570fa lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc3a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316903.684142:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe18fd7100 x1853163894106368/t8589937542(8589937542) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767316903.684155:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18fd7100 x1853163894106368/t8589937542(8589937542) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316903.684166:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713400/0xd9a0da65fad570fa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc3a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.684178:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/27 (0 0) 00000080:00200000:3.0:1767316903.684199:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767316903.684244:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x1b:0x0], updating i_size 4096 00000080:00010000:3.0:1767316903.684249:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1b:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad570fa 00000080:00010000:3.0:1767316903.684261:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570fa from it ffffa99f40d87bd0 00010000:00010000:3.0:1767316903.684265:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713400/0xd9a0da65fad570fa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc3a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.684274:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713400/0xd9a0da65fad570fa lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc3a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316903.684306:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe18fd7100 x1853163894106368/t8589937542(8589937542) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1767316903.684381:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d60a.sanity-flr:[0x200000405:0x1b:0x0](ffff9cfe0ed99148), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316903.684390:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x1b:0x0](ffff9cfe0ed99148),name=d60a.sanity-flr 00000002:00010000:3.0:1767316903.684416:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1b:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316903.684427:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.684438:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316903.684443:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316903.684449:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1b:0x0](ffff9cfe0ed99148) 00000080:00010000:3.0:1767316903.684452:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1b:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad570ec 00000080:00010000:3.0:1767316903.684455:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570ec from it ffffa99f40d87cd8 00010000:00010000:3.0:1767316903.684458:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.684465:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316903.684508:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x1b:0x0](ffff9cfe0ed99148) pos/size0/4096 32bit_api 0 00000080:00200000:3.0:1767316903.684531:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x1b:0x0](ffff9cfe0ed99148) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:3.0:1767316903.684552:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x1b:0x0](ffff9cfe0ed99148), inode mode 41ed mask 1 00000080:00200000:3.0:1767316903.684569:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f60a.sanity-flr, dir=[0x200000405:0x1b:0x0](ffff9cfe0ed99148), flags=0 00000080:00200000:3.0:1767316903.684573:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f60a.sanity-flr, dir=[0x200000405:0x1b:0x0](ffff9cfe0ed99148), intent=getattr 00000002:00010000:3.0:1767316903.684586:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f60a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000405:0x1b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316903.684633:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316903.684640:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316903.684649:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:3.0:1767316903.684669:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894106496:192.168.202.121@tcp:101:rm.0 00000100:00100000:3.0:1767316903.684763:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0918d780 going to sleep for 11 seconds 00000100:00100000:3.0:1767316903.691140:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894106496:192.168.202.121@tcp:101:rm.0 00010000:00010000:3.0:1767316903.691170:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc5d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.691206:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc5d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.691214:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc5d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.691225:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc5d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.691251:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc5d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.691264:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc5d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.691271:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc5d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.691278:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc5d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316903.691288:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18fd7800 x1853163894106496/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/824 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316903.691300:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc5d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767316903.691313:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc5d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316903.691322:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/28 (0 0) 00000080:00200000:3.0:1767316903.691329:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x1b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767316903.691364:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x1c:0x0](ffff9cfe0ec7c2c8) 00000080:00200000:3.0:1767316903.691428:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x1c:0x0], updating i_size 2147483648 00000080:00200000:3.0:1767316903.691450:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x1c:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:3.0:1767316903.691456:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1c:0x0](ffff9cfe0ec7c2c8) for lock 0xd9a0da65fad57101 00000080:00010000:3.0:1767316903.691466:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1c:0x0](ffff9cfe0ec7c2c8) 00000080:00010000:3.0:1767316903.691475:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57101 from it ffffa99f40d87df8 00010000:00010000:3.0:1767316903.691479:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655adc5d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316903.691487:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655adc5d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316903.691518:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x1b:0x0](ffff9cfe0ed99148), inode mode 41ed mask 3 00000080:00200000:3.0:1767316903.691525:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f60a.sanity-flr, dir=[0x200000405:0x1b:0x0](ffff9cfe0ed99148) 00010000:00010000:3.0:1767316903.691561:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.691578:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713400/0xd9a0da65fad570fa lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc3a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.691652:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655adc5d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767316903.691663:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x1c:0x0]: losing layout lock 00010000:00010000:3.0:1767316903.691692:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655adc5d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316903.691700:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.691705:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:3.0:1767316903.691707:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57101 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655adc5d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767316903.691721:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad570ec lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adc1e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1767316903.691748:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1767316903.691754:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe18fd7800 x1853163894106752/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767316903.691776:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894106752:192.168.202.121@tcp:36:rm.0 00000100:00100000:3.0:1767316903.691900:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0918d780 going to sleep for 11 seconds 00000100:00100000:3.0:1767316903.695634:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894106752:192.168.202.121@tcp:36:rm.0 00000080:00200000:3.0:1767316903.695694:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x1c:0x0] ignore/verify layout 1/0, layout version 11 restore needed 0 00020000:00200000:3.0:1767316903.695705:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x1c:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1767316903.695708:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1767316903.695714:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767316903.695744:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x1c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767316903.695751:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x1c:0x0](ffff9cfe0ec7c2c8) 00000080:00200008:3.0:1767316903.695846:0:83725:0:(file.c:424:ll_file_release()) START file d60a.sanity-flr:[0x200000405:0x1b:0x0](ffff9cfe0ed99148), flags 704000 00010000:00010000:3.0:1767316903.695874:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713400/0xd9a0da65fad570fa lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc3a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316903.695918:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:3.0:1767316903.695935:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316903.695945:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.695953:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316903.695960:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316903.695966:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:3.0:1767316903.695985:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad570e5 00000080:00010000:3.0:1767316903.695992:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570e5 from it ffffa99f40d87c10 00010000:00010000:3.0:1767316903.695997:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.696005:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316903.696018:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:3.0:1767316903.696033:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d60a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=0 00000080:00200000:3.0:1767316903.696037:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d60a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:3.0:1767316903.696051:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d60a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316903.696134:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316903.696142:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316903.696151:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:3.0:1767316903.696169:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894106880:192.168.202.121@tcp:101:rm.0 00000100:00100000:3.0:1767316903.696259:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0918d780 going to sleep for 11 seconds 00000100:00100000:3.0:1767316903.699865:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894106880:192.168.202.121@tcp:101:rm.0 00010000:00010000:3.0:1767316903.699903:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc95 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.699920:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc95 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.699945:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc95 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.699957:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc95 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.699968:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc95 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.699988:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc95 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.700001:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc95 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.700014:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc95 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316903.700035:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18fd4700 x1853163894106880/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316903.700050:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc95 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.700061:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/27 (0 0) 00000080:00200000:3.0:1767316903.700067:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767316903.700128:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x1b:0x0], updating i_size 4096 00000080:00200000:3.0:1767316903.700132:0:83725:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x1b:0x0](ffff9cfe0ed99148): rc = 0 00000080:00010000:3.0:1767316903.700145:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1b:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad57108 00000080:00010000:3.0:1767316903.700173:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1b:0x0](ffff9cfe0ed99148) 00000080:00010000:3.0:1767316903.700179:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57108 from it ffffa99f40d87e00 00010000:00010000:3.0:1767316903.700293:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc95 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.700302:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc95 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316903.700350:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316903.700455:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316903.700467:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.700478:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316903.700484:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316903.700489:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316903.700493:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad570e5 00000080:00010000:2.0:1767316903.700500:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad570e5 from it ffffa99f40d87d88 00010000:00010000:2.0:1767316903.700504:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.700532:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316903.700541:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:2.0:1767316903.700549:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d60a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:2.0:1767316903.700583:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.700696:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adc95 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.700720:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713400/0xd9a0da65fad570fa lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adc3a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316903.700790:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18fd7100 x1853163894106368/t8589937542(8589937542) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767316903.700808:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767316903.700825:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29109180 x1853163894107136/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767316903.700862:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894107136:192.168.202.121@tcp:35:rm.0 00000100:00100000:2.0:1767316903.700965:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202556c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.704811:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894107136:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316903.704863:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18fd7100 x1853163894106368/t8589937542(8589937542) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767316903.704945:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adc95 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.704955:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713400/0xd9a0da65fad570fa lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adc3a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.704961:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.704967:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767316903.704970:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27712600/0xd9a0da65fad57108 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adc95 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.704999:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713400/0xd9a0da65fad570fa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adc3a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.705012:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad570e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adc02 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316903.705032:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316903.705039:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558e680 x1853163894107392/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316903.705063:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558e680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894107392:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316903.705211:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.708217:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558e680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894107392:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316903.708261:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x1b:0x0](ffff9cfe0ed99148) 00000080:00200000:1.0:1767316903.708341:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.708364:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.708427:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.708436:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.708447:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.708468:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894107520:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.708802:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac180 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.712924:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894107520:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.712950:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.712963:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.712978:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.713014:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.713026:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.713036:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.713043:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.713055:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558fb80 x1853163894107520/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.713070:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.713122:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316903.713132:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316903.713165:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316903.713171:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5710f 00000080:00010000:0.0:1767316903.713176:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.713179:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5710f from it ffffa99f40d87b58 00010000:00010000:0.0:1767316903.713190:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.713199:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.713238:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.713262:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d60b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316903.713267:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d60b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316903.713294:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d60b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.713340:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.713352:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.713363:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.713386:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894107648:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.713457:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.716893:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894107648:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.716999:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.717021:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.717028:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.717038:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.717072:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.717195:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.717205:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.717212:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.717224:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11320380 x1853163894107648/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/672 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.717238:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.717248:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/31 (0 0) 00000080:00200000:0.0:1767316903.717255:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316903.717295:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x1f:0x0](ffff9cfe0edc3248) 00000002:00010000:0.0:1767316903.717323:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.717373:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.717381:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.717389:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.717421:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894107776:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.717552:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.724475:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894107776:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.724507:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.724521:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.724533:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.724544:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.724556:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.724633:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.724641:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.724653:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11323100 x1853163894107776/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.724667:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.724706:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589937616/4 (0 0) 00010000:00010000:0.0:1767316903.724717:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.724725:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.724753:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x4:0x0]) in obj [0x240000406:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.724797:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.724804:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.724811:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.724839:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894107904:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.724918:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.731362:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894107904:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.731390:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 4/1,0 mode: --/CR res: [0x240000406:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731403:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 4/1,0 mode: --/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731414:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731451:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731462:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731469:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731475:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316903.731486:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11323100 x1853163894107904/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316903.731499:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731513:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677446/4 (0 0) 00010000:00010000:0.0:1767316903.731521:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731528:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.731638:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x1f:0x0], updating i_size 8192 00000080:00010000:0.0:1767316903.731652:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1f:0x0](ffff9cfe0edc3248) for lock 0xd9a0da65fad57116 00000080:00010000:0.0:1767316903.731665:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1f:0x0](ffff9cfe0edc3248) 00000080:00010000:0.0:1767316903.731668:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57116 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316903.731678:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731685:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316903.731717:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d60b.sanity-flr:[0x200000405:0x1f:0x0](ffff9cfe0edc3248), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316903.731724:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x1f:0x0](ffff9cfe0edc3248),name=d60b.sanity-flr 00000002:00010000:0.0:1767316903.731747:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1f:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.731756:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731766:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.731774:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.731780:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731786:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731792:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731798:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.731805:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x4:0x0]) in obj [0x240000406:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.731809:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731834:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731841:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731848:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.731858:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316903.731862:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1f:0x0](ffff9cfe0edc3248) 00000080:00010000:0.0:1767316903.731865:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1f:0x0](ffff9cfe0edc3248) for lock 0xd9a0da65fad57116 00000080:00010000:0.0:1767316903.731869:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57116 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316903.731871:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731877:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.731888:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.731904:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731913:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731920:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731937:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.731947:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x4:0x0]) in obj [0x240000406:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.731952:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731959:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731967:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.731973:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.732031:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.732041:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.732047:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.732055:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.732061:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.732065:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.732067:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5710f 00000080:00010000:0.0:1767316903.732070:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5710f from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316903.732759:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.732768:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.732778:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.732786:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d60b.sanity-flr, flags=266 00000080:00200000:0.0:1767316903.732792:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x1f:0x0](ffff9cfe0edc3248), inode mode 41ed mask 44 00000080:00200008:0.0:1767316903.732801:0:83725:0:(file.c:1001:ll_file_open()) START file d60b.sanity-flr:[0x200000405:0x1f:0x0](ffff9cfe0edc3248), flags 704400 00000002:00010000:0.0:1767316903.732829:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1f:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316903.732888:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5712b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.733740:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5712b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316903.733757:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316903.733768:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11320380 x1853163894108160/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316903.733778:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5712b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.733801:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894108160:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.735888:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.745275:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894108160:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316903.745300:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5712b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.745316:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5712b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.745341:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5712b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.745349:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5712b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.745358:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5712b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.745364:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037d200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316903.745369:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5712b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.745376:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5712b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.745383:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5712b lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.745389:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316903.745395:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5712b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.745401:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5712b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316903.745423:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe11320380 x1853163894108160/t8589937546(8589937546) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316903.745438:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11320380 x1853163894108160/t8589937546(8589937546) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316903.745454:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316903.745489:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x1f:0x0], updating i_size 4096 00000002:00100000:0.0:1767316903.745507:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11320380 x1853163894108160/t8589937546(8589937546) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316903.745585:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d60b.sanity-flr:[0x200000405:0x1f:0x0](ffff9cfe0edc3248), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316903.745593:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x1f:0x0](ffff9cfe0edc3248),name=d60b.sanity-flr 00000002:00010000:0.0:1767316903.745616:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1f:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.745630:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.745642:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.745651:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.745657:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.745664:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.745671:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.745679:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.745695:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x4:0x0]) in obj [0x240000406:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.745701:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.745720:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.745727:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.745734:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.745743:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316903.745748:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1f:0x0](ffff9cfe0edc3248) 00000080:00010000:0.0:1767316903.745752:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1f:0x0](ffff9cfe0edc3248) for lock 0xd9a0da65fad57116 00000080:00010000:0.0:1767316903.745757:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57116 from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316903.745760:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.745766:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.745777:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.745782:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.745790:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.745796:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.745813:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.745833:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x4:0x0]) in obj [0x240000406:0x4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.745838:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.745846:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.745853:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.745860:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.745889:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x1f:0x0](ffff9cfe0edc3248) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767316903.747095:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316903.747134:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316903.747143:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.747152:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316903.747773:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894108288:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316903.753109:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.763040:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894108288:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316903.763922:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.763938:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316903.764141:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x4:0x0]) in obj [0x240000406:0x4:0x0], intent: readdir flags 0 00010000:00010000:2.0:1767316903.764158:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.764173:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1767316903.765073:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894108416:192.168.202.121@tcp:37:rm.0 00000100:00100000:2.0:1767316903.766219:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255b40 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.775559:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894108416:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316903.776467:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.776483:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316903.776843:0:83725:0:(file.c:424:ll_file_release()) START file d60b.sanity-flr:[0x200000405:0x1f:0x0](ffff9cfe0edc3248), flags 704000 00000002:00100000:1.0:1767316903.777008:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe11320380 x1853163894108160/t8589937546(8589937546) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316903.777035:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316903.777041:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558d500 x1853163894108672/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316903.777065:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894108672:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316903.777245:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.782200:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894108672:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316903.782238:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe11320380 x1853163894108160/t8589937546(8589937546) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316903.782319:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.782338:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.782354:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.782366:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.782373:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.782379:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.782383:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5710f 00000080:00010000:1.0:1767316903.782389:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5710f from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316903.782393:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.782402:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.782436:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.782442:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d60b.sanity-flr, flags=266 00000080:00200000:1.0:1767316903.782449:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x1f:0x0](ffff9cfe0edc3248), inode mode 41ed mask 44 00000080:00200008:1.0:1767316903.782457:0:83725:0:(file.c:1001:ll_file_open()) START file d60b.sanity-flr:[0x200000405:0x1f:0x0](ffff9cfe0edc3248), flags 704400 00000002:00010000:1.0:1767316903.782473:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1f:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767316903.782519:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57132 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.782526:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57132 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316903.782537:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316903.782544:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558d500 x1853163894108928/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316903.782553:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57132 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.782649:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894108928:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.783030:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.786738:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894108928:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.786774:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57132 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.786784:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57132 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.786795:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57132 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.786831:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57132 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.786848:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe0558d500 x1853163894108928/t8589937548(8589937548) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316903.786860:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558d500 x1853163894108928/t8589937548(8589937548) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.786874:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57132 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.786884:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/31 (0 0) 00000080:00200000:1.0:1767316903.786891:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.787008:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x1f:0x0], updating i_size 4096 00000080:00010000:1.0:1767316903.787016:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1f:0x0](ffff9cfe0edc3248) for lock 0xd9a0da65fad57132 00000080:00010000:1.0:1767316903.787025:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57132 from it ffffa99f40d87bd0 00010000:00010000:1.0:1767316903.787028:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57132 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.787038:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57132 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.787062:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558d500 x1853163894108928/t8589937548(8589937548) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316903.791609:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d60b.sanity-flr:[0x200000405:0x1f:0x0](ffff9cfe0edc3248), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316903.791626:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x1f:0x0](ffff9cfe0edc3248),name=d60b.sanity-flr 00000002:00010000:1.0:1767316903.791661:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x1f:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.791688:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.791703:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.791714:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.791720:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.791728:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.791738:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.791746:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.791761:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x4:0x0]) in obj [0x240000406:0x4:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.791768:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.791775:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.791781:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.791787:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.791804:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316903.791811:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x1f:0x0](ffff9cfe0edc3248) 00000080:00010000:1.0:1767316903.791846:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x1f:0x0](ffff9cfe0edc3248) for lock 0xd9a0da65fad57116 00000080:00010000:1.0:1767316903.791852:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57116 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316903.791855:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.791862:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.791875:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.791880:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.791887:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.791894:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.792036:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.792045:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x4:0x0]) in obj [0x240000406:0x4:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.792051:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.792058:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.792074:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.792100:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.792137:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x1f:0x0](ffff9cfe0edc3248) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767316903.792150:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.792172:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x4:0x0]) in obj [0x200000bd0:0x4:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316903.792178:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.792186:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767316903.792197:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767316903.792201:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.792207:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.792217:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x4:0x0]) in obj [0x240000406:0x4:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316903.792222:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.792229:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1767316903.792245:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1767316903.792248:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.792256:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.792290:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x1f:0x0](ffff9cfe0edc3248) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:1.0:1767316903.792312:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x1f:0x0](ffff9cfe0edc3248), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.792328:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f60b.sanity-flr, dir=[0x200000405:0x1f:0x0](ffff9cfe0edc3248), flags=0 00000080:00200000:1.0:1767316903.792332:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f60b.sanity-flr, dir=[0x200000405:0x1f:0x0](ffff9cfe0edc3248), intent=getattr 00000002:00010000:1.0:1767316903.792348:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f60b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x4:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.792398:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.792406:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.792417:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.792444:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894109056:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.792534:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.795614:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894109056:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.795643:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add2f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.795666:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add2f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.795689:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add2f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.795700:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add2f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.795712:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add2f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.795725:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add2f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.795733:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add2f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.795740:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add2f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.795751:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558fb80 x1853163894109056/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/720 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.795763:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 136 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add2f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.795775:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add2f expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.795786:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/32 (0 0) 00000080:00200000:1.0:1767316903.795792:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x4:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316903.795843:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x20:0x0](ffff9cfe0ed99148) 00000080:00200000:1.0:1767316903.796073:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x20:0x0]: layout version change: 4294967294 -> 41 00000080:00010000:1.0:1767316903.796103:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x20:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad57139 00000080:00010000:1.0:1767316903.796115:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x20:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316903.796118:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57139 from it ffffa99f40d87df8 00010000:00010000:1.0:1767316903.796121:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655add2f expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.796130:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655add2f expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316903.796169:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x1f:0x0](ffff9cfe0edc3248), inode mode 41ed mask 3 00000080:00200000:1.0:1767316903.796178:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f60b.sanity-flr, dir=[0x200000405:0x1f:0x0](ffff9cfe0edc3248) 00010000:00010000:1.0:1767316903.796213:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.796294:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655add2f expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316903.796306:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x20:0x0]: losing layout lock 00010000:00010000:1.0:1767316903.796340:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655add2f expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.796347:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.796352:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316903.796355:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57139 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655add2f expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.796368:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5711d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adce2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316903.796395:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316903.796403:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558fb80 x1853163894109312/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316903.796426:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894109312:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316903.796510:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.800555:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558fb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894109312:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316903.800627:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x20:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316903.800642:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316903.800674:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x20:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316903.800681:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x20:0x0](ffff9cfe0ed99148) 00000080:00200008:1.0:1767316903.800768:0:83725:0:(file.c:424:ll_file_release()) START file d60b.sanity-flr:[0x200000405:0x1f:0x0](ffff9cfe0edc3248), flags 704000 00010000:00010000:1.0:1767316903.800795:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57132 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.800846:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.800865:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.800874:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.800883:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.800889:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.800980:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.800984:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5710f 00000080:00010000:1.0:1767316903.800992:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5710f from it ffffa99f40d87c10 00010000:00010000:1.0:1767316903.801009:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.801017:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.801032:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.801042:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d60b.sanity-flr, flags=0 00000080:00200000:1.0:1767316903.801047:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.801056:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.801062:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.801069:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.801074:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.801102:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.801105:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5710f 00000080:00010000:1.0:1767316903.801109:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5710f from it ffffa99f40d87d88 00010000:00010000:1.0:1767316903.801112:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.801119:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.801127:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316903.801132:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d60b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316903.801152:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.801377:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57132 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655add0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.801427:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0558d500 x1853163894108928/t8589937548(8589937548) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316903.801441:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316903.801446:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558c000 x1853163894109568/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316903.801467:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894109568:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316903.801558:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.806401:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894109568:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316903.806442:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0558d500 x1853163894108928/t8589937548(8589937548) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767316903.806498:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.806546:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57132 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655add0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.806554:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.806560:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.806578:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767316903.806597:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57132 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655add0c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.806610:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57116 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adcd4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.806623:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad5710f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adcb8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316903.806644:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316903.806651:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558c000 x1853163894109824/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316903.806673:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894109824:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316903.806760:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:3.0:1767316903.810653:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316903.810802:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939835776 00000100:00100000:2.0:1767316903.810812:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939835776 00000100:00100000:2.0:1767316903.810900:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10257 00000100:00100000:2.0:1767316903.810920:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:16197:x1853163939835776:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316903.810937:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.811026:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316903.811034:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:16197:x1853163939835776:12345-192.168.202.121@tcp:104: Request processed in 116us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316903.811041:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10257 00010000:00010000:0.0:1767316903.811425:0:49629:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316903.811434:0:49629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.811443:0:49629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037de00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316903.811448:0:49629:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.811456:0:49629:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.811464:0:49629:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.811607:0:49629:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 2/0,0 mode: --/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.811614:0:49629:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316903.811648:0:49629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 1/0,0 mode: --/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.811656:0:49629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57124 lrc: 0/0,0 mode: --/PR res: [0x240000406:0x4:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655adcf0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.811673:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316903.811675:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316903.811677:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316903.811686:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316903.811700:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894109952:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316903.820726:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894109952:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316903.832047:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558c000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894109824:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316903.832129:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x1f:0x0](ffff9cfe0edc3248) 00000080:00200000:1.0:1767316903.832229:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.832251:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.832312:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.832323:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.832333:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.832352:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894110080:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.832445:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.835063:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894110080:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.835122:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.835134:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.835145:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.835155:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.835166:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.835173:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.835193:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.835205:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558d500 x1853163894110080/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.835217:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.835229:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316903.835235:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.835271:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316903.835278:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57140 00000080:00010000:1.0:1767316903.835283:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.835287:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57140 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316903.835291:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.835298:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.835324:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.835343:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d61a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316903.835348:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d61a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316903.835370:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d61a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.835408:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.835415:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.835423:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.835444:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894110208:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.835526:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.838272:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894110208:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.838299:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.838320:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.838341:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.838351:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.838362:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.838373:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.838380:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.838387:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.838398:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558d500 x1853163894110208/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.838410:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.838421:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 9663677445/16 (0 0) 00000002:00010000:1.0:1767316903.838438:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000405:0x10:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.838487:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.838505:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.838515:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.838534:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894110336:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.838624:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.843296:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894110336:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.843322:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 4/1,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.843334:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 4/1,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.843344:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.843354:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.843365:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.843373:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.843379:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.843412:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558dc00 x1853163894110336/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.843424:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.843437:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/16 (0 0) 00000080:00200000:1.0:1767316903.843460:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316903.843492:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000405:0x10:0x0](ffff9cfe0ed99148) 00000080:00200000:1.0:1767316903.843499:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x10:0x0], updating i_size 4096 00000080:00010000:1.0:1767316903.843507:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000405:0x10:0x0](ffff9cfe0ed99148) for remote lock 0xd9a0da65fad5714e 00000080:00010000:1.0:1767316903.843512:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x10:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad57147 00000080:00010000:1.0:1767316903.843522:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x10:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316903.843525:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57147 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316903.843529:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.843538:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767316903.843555:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad5714e from it ffffa99f40d87b20 00010000:00010000:1.0:1767316903.843559:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.843638:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316903.843673:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d61a.sanity-flr:[0x240000405:0x10:0x0](ffff9cfe0ed99148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316903.843686:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0x10:0x0](ffff9cfe0ed99148),name=d61a.sanity-flr 00000002:00010000:1.0:1767316903.843710:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.843719:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.843730:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.843736:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.843741:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x10:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316903.843744:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x10:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad5714e 00000080:00010000:1.0:1767316903.843748:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5714e from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316903.843751:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.843758:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.843825:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.843835:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.843843:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.843851:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.843857:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.843861:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.843864:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57140 00000080:00010000:1.0:1767316903.843876:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57140 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316903.843880:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.843886:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.843894:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.844003:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d61a.sanity-flr, flags=266 00000080:00200000:1.0:1767316903.844009:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x10:0x0](ffff9cfe0ed99148), inode mode 41ed mask 44 00000100:00100000:1.0:1767316903.844062:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894110464:192.168.202.121@tcp:49:rm.0 00000100:00100000:1.0:1767316903.844501:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.846865:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894110464:192.168.202.121@tcp:49:rm.0 00000080:00200008:1.0:1767316903.846914:0:83725:0:(file.c:1001:ll_file_open()) START file d61a.sanity-flr:[0x240000405:0x10:0x0](ffff9cfe0ed99148), flags 704400 00000002:00010000:1.0:1767316903.846944:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767316903.847006:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57155 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.847015:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57155 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316903.847025:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316903.847032:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558dc00 x1853163894110720/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316903.847042:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57155 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.847062:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894110720:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.847636:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.850798:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894110720:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.850830:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57155 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.850842:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57155 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.850849:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57155 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.850855:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57155 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.850862:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57155 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.850869:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2dc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316903.850874:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57155 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.850880:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57155 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.850886:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57155 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.850893:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316903.850900:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57155 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.850906:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57155 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:1.0:1767316903.850951:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe0558dc00 x1853163894110720/t4294975977(4294975977) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316903.850964:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558dc00 x1853163894110720/t4294975977(4294975977) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316903.850976:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.850996:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x10:0x0], updating i_size 4096 00000002:00100000:1.0:1767316903.851016:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558dc00 x1853163894110720/t4294975977(4294975977) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316903.851135:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d61a.sanity-flr:[0x240000405:0x10:0x0](ffff9cfe0ed99148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316903.851143:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0x10:0x0](ffff9cfe0ed99148),name=d61a.sanity-flr 00000002:00010000:1.0:1767316903.851168:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.851194:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.851207:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.851215:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.851221:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x10:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316903.851225:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x10:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad5714e 00000080:00010000:1.0:1767316903.851231:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5714e from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316903.851234:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.851242:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.851291:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0x10:0x0](ffff9cfe0ed99148) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1767316903.851304:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x10:0x0]) in obj [0x240000405:0x10:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316903.851311:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.851318:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316903.852667:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894110848:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316903.852833:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.859894:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894110848:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316903.860587:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.860603:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316903.860662:0:83725:0:(file.c:424:ll_file_release()) START file d61a.sanity-flr:[0x240000405:0x10:0x0](ffff9cfe0ed99148), flags 704000 00000002:00100000:1.0:1767316903.860728:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0558dc00 x1853163894110720/t4294975977(4294975977) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316903.860740:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316903.860746:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558d500 x1853163894111104/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316903.860768:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894111104:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316903.860862:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.863870:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894111104:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316903.863921:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0558dc00 x1853163894110720/t4294975977(4294975977) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316903.864002:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.864021:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.864036:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.864050:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.864057:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.864062:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.864066:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57140 00000080:00010000:1.0:1767316903.864072:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57140 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316903.864075:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.864140:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.864154:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.864161:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d61a.sanity-flr, flags=266 00000080:00200000:1.0:1767316903.864170:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x10:0x0](ffff9cfe0ed99148), inode mode 41ed mask 44 00000100:00100000:1.0:1767316903.864219:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894111232:192.168.202.121@tcp:49:rm.0 00000100:00100000:1.0:1767316903.864306:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.867365:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894111232:192.168.202.121@tcp:49:rm.0 00000080:00200008:1.0:1767316903.867424:0:83725:0:(file.c:1001:ll_file_open()) START file d61a.sanity-flr:[0x240000405:0x10:0x0](ffff9cfe0ed99148), flags 704400 00000002:00010000:1.0:1767316903.867457:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767316903.867521:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5715c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.867530:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5715c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316903.867543:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316903.867551:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558d500 x1853163894111488/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316903.867560:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5715c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.867778:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894111488:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.868132:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.871640:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894111488:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.871687:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5715c lrc: 4/1,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addc9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.871698:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5715c lrc: 4/1,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addc9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.871709:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5715c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655addc9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.871719:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5715c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addc9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.871753:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe0558d500 x1853163894111488/t4294975979(4294975979) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316903.871766:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558d500 x1853163894111488/t4294975979(4294975979) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.871776:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5715c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addc9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.871787:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 16 res 9663677445/16 (0 0) 00000080:00200000:1.0:1767316903.871794:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.871822:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x10:0x0], updating i_size 4096 00000080:00010000:1.0:1767316903.871827:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x10:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad5715c 00000080:00010000:1.0:1767316903.871833:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5715c from it ffffa99f40d87bd0 00010000:00010000:1.0:1767316903.871837:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5715c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655addc9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.871845:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5715c lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addc9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.871870:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558d500 x1853163894111488/t4294975979(4294975979) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316903.871946:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d61a.sanity-flr:[0x240000405:0x10:0x0](ffff9cfe0ed99148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316903.871954:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0x10:0x0](ffff9cfe0ed99148),name=d61a.sanity-flr 00000002:00010000:1.0:1767316903.871976:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.871987:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.872008:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.872014:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.872019:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x10:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316903.872023:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x10:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad5714e 00000080:00010000:1.0:1767316903.872027:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5714e from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316903.872030:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.872037:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.872072:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0x10:0x0](ffff9cfe0ed99148) pos/size0/4096 32bit_api 0 00000080:00200000:1.0:1767316903.872132:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0x10:0x0](ffff9cfe0ed99148) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1767316903.872153:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x10:0x0](ffff9cfe0ed99148), inode mode 41ed mask 1 00000100:00100000:1.0:1767316903.872212:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894111616:192.168.202.121@tcp:49:rm.0 00000100:00100000:1.0:1767316903.872614:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.875171:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894111616:192.168.202.121@tcp:49:rm.0 00000080:00200000:1.0:1767316903.875362:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f61a.sanity-flr, dir=[0x240000405:0x10:0x0](ffff9cfe0ed99148), flags=0 00000080:00200000:1.0:1767316903.875369:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f61a.sanity-flr, dir=[0x240000405:0x10:0x0](ffff9cfe0ed99148), intent=getattr 00000002:00010000:1.0:1767316903.875402:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f61a.sanity-flr,[0x0:0x0:0x0]) in obj [0x240000405:0x10:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.875460:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.875469:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.875494:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.875514:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894111744:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.875724:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.879863:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894111744:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.879890:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addec expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.880000:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addec expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.880007:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addec expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.880017:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655addec expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.880028:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addec expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.880040:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655addec expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.880047:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655addec expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.880055:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655addec expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.880251:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558dc00 x1853163894111744/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/1136 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.880264:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 552 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addec expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.880276:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addec expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.880287:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/17 (0 0) 00000080:00200000:1.0:1767316903.880293:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000405:0x10:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316903.880328:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000405:0x11:0x0](ffff9cfe0ed9b248) 00000080:00200000:1.0:1767316903.880391:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x11:0x0], updating i_size 5 00000080:00200000:1.0:1767316903.880416:0:83725:0:(file.c:6809:ll_layout_conf()) [0x240000405:0x11:0x0]: layout version change: 4294967294 -> 8 00000080:00010000:1.0:1767316903.880421:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x11:0x0](ffff9cfe0ed9b248) for lock 0xd9a0da65fad57163 00000080:00010000:1.0:1767316903.880431:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x11:0x0](ffff9cfe0ed9b248) 00000080:00010000:1.0:1767316903.880434:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57163 from it ffffa99f40d87df8 00010000:00010000:1.0:1767316903.880437:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655addec expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.880445:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655addec expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316903.880480:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x10:0x0](ffff9cfe0ed99148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316903.880492:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f61a.sanity-flr, dir=[0x240000405:0x10:0x0](ffff9cfe0ed99148) 00010000:00010000:1.0:1767316903.880524:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.880811:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655addec expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316903.880832:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x240000405:0x11:0x0]: losing layout lock 00010000:00010000:1.0:1767316903.880866:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655addec expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.880873:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 1/0,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.880879:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316903.880882:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57163 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655addec expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.880997:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5714e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655addad expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316903.881015:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316903.881023:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558dc00 x1853163894112000/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316903.881047:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894112000:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316903.881275:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.886557:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558dc00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894112000:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316903.886688:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x240000405:0x11:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316903.886701:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000405:0x11:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316903.886705:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316903.886721:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1767316903.886731:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1767316903.886751:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x240000405:0x11:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316903.886758:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000405:0x11:0x0](ffff9cfe0ed9b248) 00000080:00200008:1.0:1767316903.886859:0:83725:0:(file.c:424:ll_file_release()) START file d61a.sanity-flr:[0x240000405:0x10:0x0](ffff9cfe0ed99148), flags 704000 00010000:00010000:1.0:1767316903.886886:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5715c lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655addc9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.887015:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.887033:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.887044:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.887055:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.887061:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.887067:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.887070:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57140 00000080:00010000:1.0:1767316903.887076:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57140 from it ffffa99f40d87c10 00010000:00010000:1.0:1767316903.887104:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.887113:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.887127:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.887143:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d61a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=0 00000080:00200000:1.0:1767316903.887147:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d61a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316903.887161:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d61a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.887328:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.887337:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.887347:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.887368:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894112128:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.887513:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:3.0:1767316903.891555:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894112128:192.168.202.121@tcp:101:rm.0 00010000:00010000:3.0:1767316903.891589:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.891607:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 4/1,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.891614:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 4/1,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.891625:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.891637:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.891648:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.891675:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.891681:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316903.891692:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558f100 x1853163894112128/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316903.891705:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.891715:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.891726:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.891734:0:83725:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.891740:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.891745:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316903.891768:0:83725:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000002:00010000:3.0:1767316903.891784:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000405:0x10:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316903.891868:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316903.891876:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:3.0:1767316903.891884:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316903.892066:0:63296:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1767316903.892074:0:63296:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.892103:0:63296:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d400 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:2.0:1767316903.892107:0:63296:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.892114:0:63296:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.892121:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.892148:0:63296:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.892175:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.892199:0:63296:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767316903.892224:0:63296:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 1/0,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.892231:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d400/0xd9a0da65fad5716a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ade24 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.892245:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316903.892247:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316903.892249:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316903.892265:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894112384:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316903.893860:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894112256:192.168.202.121@tcp:101:rm.0 00000100:00100000:3.0:1767316903.894036:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe0918de40 going to sleep for 11 seconds 00000100:00100000:2.0:1767316903.895427:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894112384:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316903.898155:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894112256:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.898192:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade32 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.898205:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade32 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.898217:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade32 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.898227:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade32 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.898237:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade32 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.898245:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade32 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.898253:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade32 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.898280:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe18fd5880 x1853163894112256/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.898292:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade32 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.898305:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/16 (0 0) 00000080:00200000:1.0:1767316903.898329:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316903.898351:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x10:0x0], updating i_size 4096 00000080:00200000:1.0:1767316903.898354:0:83725:0:(namei.c:151:ll_iget()) got inode: [0x240000405:0x10:0x0](ffff9cfe0ed99148): rc = 0 00000080:00010000:1.0:1767316903.898360:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000405:0x10:0x0](ffff9cfe0ed99148) for remote lock 0xd9a0da65fad57171 00000080:00010000:1.0:1767316903.898364:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x10:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad57147 00000080:00010000:1.0:1767316903.898374:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x10:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316903.898377:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57147 from it ffffa99f40d87e00 00010000:00010000:1.0:1767316903.898381:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.898390:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767316903.898402:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad57171 from it ffffa99f40d87e00 00010000:00010000:1.0:1767316903.898405:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade32 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.898411:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade32 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.898429:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.898454:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.898464:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.898473:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.898480:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.898484:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.898487:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57140 00000080:00010000:1.0:1767316903.898490:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57140 from it ffffa99f40d87d88 00010000:00010000:1.0:1767316903.898492:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.898498:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.898506:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316903.898514:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d61a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316903.898534:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.898729:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.898736:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316903.898762:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57147 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655add9f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316903.898792:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316903.898825:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894112512:192.168.202.121@tcp:103:rm.0 00010000:00010000:1.0:1767316903.898928:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ade32 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.898944:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5715c lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655addc9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.898978:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0558d500 x1853163894111488/t4294975979(4294975979) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316903.898989:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316903.898993:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558e300 x1853163894112768/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316903.899007:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894112768:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316903.899041:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.902240:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894112768:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316903.902276:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0558d500 x1853163894111488/t4294975979(4294975979) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767316903.902346:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ade32 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.902355:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5715c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655addc9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.902361:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316903.902363:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe27712400/0xd9a0da65fad57171 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ade32 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.902388:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad5715c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655addc9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316903.902410:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316903.902416:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558e300 x1853163894113024/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316903.902439:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894113024:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316903.902505:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:3.0:1767316903.906717:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316903.906822:0:42041:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1767316903.906842:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939836672 00000100:00100000:2.0:1767316903.906850:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939836672 00000100:00100000:2.0:1767316903.906911:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10258 00000100:00100000:2.0:1767316903.906923:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe28138450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:16197:x1853163939836672:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316903.906941:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316903.907024:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316903.907045:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe28138450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:16197:x1853163939836672:12345-192.168.202.121@tcp:104: Request processed in 125us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316903.907053:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10258 00000100:00100000:1.0:1767316903.907382:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894112512:192.168.202.121@tcp:103:rm.0 00010000:00010000:0.0:1767316903.907740:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316903.907747:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.907756:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2ca00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316903.907762:0:63142:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.907770:0:63142:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.907792:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.907855:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.907861:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316903.907882:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.907888:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad57140 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655add83 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.907906:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316903.907908:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316903.907910:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316903.907922:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894113152:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316903.917211:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894113152:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316903.920602:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558e300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894113024:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316903.920647:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000405:0x10:0x0](ffff9cfe0ed99148) 00000080:00200000:1.0:1767316903.920721:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.920744:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.920801:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.920810:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.920830:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.920850:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894113280:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.920945:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.925256:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894113280:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.925300:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.925312:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.925323:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.925332:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.925343:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.925351:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.925359:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.925370:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558f100 x1853163894113280/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.925383:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.925395:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316903.925402:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.925427:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316903.925442:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57178 00000080:00010000:1.0:1767316903.925448:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.925451:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57178 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316903.925454:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.925462:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.925492:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.925513:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d61b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316903.925518:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d61b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316903.925542:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d61b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.925786:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.925793:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.925803:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.925836:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894113408:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.925984:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.929982:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894113408:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.930011:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.930033:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 4/1,0 mode: --/PR res: [0x200000405:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.930056:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 4/1,0 mode: --/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.930066:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.930077:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.930390:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.930399:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.930406:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.930417:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558f100 x1853163894113408/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.930429:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.930440:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/73 (0 0) 00000080:00200000:1.0:1767316903.930448:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316903.930648:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x49:0x0](ffff9cfe0edc0908) 00000080:00200000:0.0:1767316903.930658:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x49:0x0], updating i_size 4096 00000080:00010000:0.0:1767316903.930667:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x49:0x0](ffff9cfe0edc0908) for lock 0xd9a0da65fad5717f 00000080:00010000:0.0:1767316903.930681:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x49:0x0](ffff9cfe0edc0908) 00000080:00010000:0.0:1767316903.932744:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5717f from it ffffa99f40d87b20 00010000:00010000:0.0:1767316903.932761:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.932774:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316903.932856:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d61b.sanity-flr:[0x200000405:0x49:0x0](ffff9cfe0edc0908), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316903.932864:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x49:0x0](ffff9cfe0edc0908),name=d61b.sanity-flr 00000002:00010000:0.0:1767316903.932888:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x49:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.932912:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.932923:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.932930:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.932936:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x49:0x0](ffff9cfe0edc0908) 00000080:00010000:0.0:1767316903.932939:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x49:0x0](ffff9cfe0edc0908) for lock 0xd9a0da65fad5717f 00000080:00010000:0.0:1767316903.932943:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5717f from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316903.932945:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.932951:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.933005:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316903.933014:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316903.933021:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.933027:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.933033:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316903.933044:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316903.933047:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57178 00000080:00010000:0.0:1767316903.933051:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57178 from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316903.933054:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316903.933060:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316903.933068:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316903.933074:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d61b.sanity-flr, flags=266 00000080:00200000:0.0:1767316903.933096:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x49:0x0](ffff9cfe0edc0908), inode mode 41ed mask 44 00000100:00100000:0.0:1767316903.933151:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894113536:192.168.202.121@tcp:49:rm.0 00000100:00100000:0.0:1767316903.933436:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316903.935849:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894113536:192.168.202.121@tcp:49:rm.0 00000080:00200008:0.0:1767316903.935891:0:83725:0:(file.c:1001:ll_file_open()) START file d61b.sanity-flr:[0x200000405:0x49:0x0](ffff9cfe0edc0908), flags 704400 00000002:00010000:0.0:1767316903.935930:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x49:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316903.935987:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57186 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316903.935996:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57186 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316903.936006:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316903.936014:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11323100 x1853163894113792/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316903.936022:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57186 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316903.936058:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894113792:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316903.936243:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.939073:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894113792:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.939129:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57186 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.939157:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57186 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.939163:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57186 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.939170:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57186 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.939177:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57186 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.939183:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037de00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316903.939188:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57186 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.939194:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57186 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.939202:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57186 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.939209:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316903.939215:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57186 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.939221:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57186 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:1.0:1767316903.939239:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe11323100 x1853163894113792/t8589937553(8589937553) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316903.939252:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11323100 x1853163894113792/t8589937553(8589937553) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316903.939271:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.939292:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x49:0x0], updating i_size 4096 00000002:00100000:1.0:1767316903.939310:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11323100 x1853163894113792/t8589937553(8589937553) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316903.939378:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d61b.sanity-flr:[0x200000405:0x49:0x0](ffff9cfe0edc0908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316903.939385:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x49:0x0](ffff9cfe0edc0908),name=d61b.sanity-flr 00000002:00010000:1.0:1767316903.939408:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x49:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.939422:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.939434:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.939441:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.939446:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x49:0x0](ffff9cfe0edc0908) 00000080:00010000:1.0:1767316903.939449:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x49:0x0](ffff9cfe0edc0908) for lock 0xd9a0da65fad5717f 00000080:00010000:1.0:1767316903.939454:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5717f from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316903.939457:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.939465:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.939495:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x49:0x0](ffff9cfe0edc0908) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1767316903.939508:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x49:0x0]) in obj [0x200000405:0x49:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316903.939514:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.939533:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316903.940420:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894113920:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316903.940846:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.948880:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894113920:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316903.949582:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.949597:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316903.949659:0:83725:0:(file.c:424:ll_file_release()) START file d61b.sanity-flr:[0x200000405:0x49:0x0](ffff9cfe0edc0908), flags 704000 00000002:00100000:1.0:1767316903.949723:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe11323100 x1853163894113792/t8589937553(8589937553) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316903.949734:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316903.949739:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558d500 x1853163894114176/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316903.949759:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894114176:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316903.949855:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.952973:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894114176:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316903.953004:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe11323100 x1853163894113792/t8589937553(8589937553) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316903.953127:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.953164:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.953183:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.953197:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.953204:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.953210:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.953214:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57178 00000080:00010000:1.0:1767316903.953221:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57178 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316903.953225:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.953234:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.953248:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.953254:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d61b.sanity-flr, flags=266 00000080:00200000:1.0:1767316903.953261:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x49:0x0](ffff9cfe0edc0908), inode mode 41ed mask 44 00000100:00100000:1.0:1767316903.953299:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894114304:192.168.202.121@tcp:49:rm.0 00000100:00100000:1.0:1767316903.953378:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.955784:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894114304:192.168.202.121@tcp:49:rm.0 00000080:00200008:1.0:1767316903.955833:0:83725:0:(file.c:1001:ll_file_open()) START file d61b.sanity-flr:[0x200000405:0x49:0x0](ffff9cfe0edc0908), flags 704400 00000002:00010000:1.0:1767316903.955863:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x49:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767316903.955930:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5718d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.955954:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5718d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316903.955967:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316903.955975:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558d500 x1853163894114560/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316903.955983:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5718d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.956002:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894114560:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.956202:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.959368:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894114560:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.959403:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5718d lrc: 4/1,0 mode: --/CR res: [0x200000405:0x49:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adea9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.959414:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5718d lrc: 4/1,0 mode: --/CR res: [0x200000405:0x49:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adea9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.959427:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5718d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x49:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adea9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.959438:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5718d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x49:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adea9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.959451:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe0558d500 x1853163894114560/t8589937555(8589937555) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316903.959464:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558d500 x1853163894114560/t8589937555(8589937555) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.959493:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5718d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x49:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adea9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.959506:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/73 (0 0) 00000080:00200000:1.0:1767316903.959512:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.959535:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x49:0x0], updating i_size 4096 00000080:00010000:1.0:1767316903.959540:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x49:0x0](ffff9cfe0edc0908) for lock 0xd9a0da65fad5718d 00000080:00010000:1.0:1767316903.959548:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5718d from it ffffa99f40d87bd0 00010000:00010000:1.0:1767316903.959552:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5718d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x49:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adea9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.959560:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5718d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x49:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adea9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.959593:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558d500 x1853163894114560/t8589937555(8589937555) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316903.959657:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d61b.sanity-flr:[0x200000405:0x49:0x0](ffff9cfe0edc0908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316903.959665:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x49:0x0](ffff9cfe0edc0908),name=d61b.sanity-flr 00000002:00010000:1.0:1767316903.959687:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x49:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.959699:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.959710:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.959716:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.959720:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x49:0x0](ffff9cfe0edc0908) 00000080:00010000:1.0:1767316903.959729:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x49:0x0](ffff9cfe0edc0908) for lock 0xd9a0da65fad5717f 00000080:00010000:1.0:1767316903.959733:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5717f from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316903.959736:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.959743:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.959776:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x49:0x0](ffff9cfe0edc0908) pos/size0/4096 32bit_api 0 00000080:00200000:1.0:1767316903.959799:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x49:0x0](ffff9cfe0edc0908) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1767316903.959833:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x49:0x0](ffff9cfe0edc0908), inode mode 41ed mask 1 00000100:00100000:1.0:1767316903.959897:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558df80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894114688:192.168.202.121@tcp:49:rm.0 00000100:00100000:1.0:1767316903.959993:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.962535:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558df80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894114688:192.168.202.121@tcp:49:rm.0 00000080:00200000:1.0:1767316903.962597:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f61b.sanity-flr, dir=[0x200000405:0x49:0x0](ffff9cfe0edc0908), flags=0 00000080:00200000:1.0:1767316903.962603:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f61b.sanity-flr, dir=[0x200000405:0x49:0x0](ffff9cfe0edc0908), intent=getattr 00000002:00010000:1.0:1767316903.962627:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f61b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000405:0x49:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.962681:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.962690:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.962699:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.962718:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558df80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894114816:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.962861:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.966025:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558df80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894114816:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.966050:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adecc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.966074:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adecc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.966102:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adecc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.966115:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adecc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.966125:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adecc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.966137:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adecc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.966145:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adecc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.966153:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adecc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.966164:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558df80 x1853163894114816/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/824 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.966175:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adecc expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316903.966359:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adecc expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.966371:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/74 (0 0) 00000080:00200000:1.0:1767316903.966379:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x49:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316903.966412:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x4a:0x0](ffff9cfe0ed99148) 00000080:00200000:1.0:1767316903.966473:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x4a:0x0], updating i_size 5 00000080:00200000:1.0:1767316903.966496:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x4a:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1767316903.966503:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4a:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad57194 00000080:00010000:1.0:1767316903.966514:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4a:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316903.966519:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57194 from it ffffa99f40d87df8 00010000:00010000:1.0:1767316903.966522:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655adecc expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.966530:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655adecc expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316903.966643:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x49:0x0](ffff9cfe0edc0908), inode mode 41ed mask 3 00000080:00200000:1.0:1767316903.966656:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f61b.sanity-flr, dir=[0x200000405:0x49:0x0](ffff9cfe0edc0908) 00010000:00010000:1.0:1767316903.966688:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.966706:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5718d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x49:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adea9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.966781:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655adecc expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316903.966805:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x4a:0x0]: losing layout lock 00010000:00010000:1.0:1767316903.966845:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655adecc expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.966853:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 1/0,0 mode: --/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.966858:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316903.966861:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad57194 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655adecc expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316903.966877:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad5717f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ade8d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316903.966893:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316903.966996:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558df80 x1853163894115072/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316903.967019:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558df80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894115072:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316903.967226:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.971621:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558df80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894115072:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316903.971675:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x4a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316903.971688:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x4a:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316903.971691:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316903.971698:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316903.971724:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x4a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316903.971731:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x4a:0x0](ffff9cfe0ed99148) 00000080:00200008:1.0:1767316903.971838:0:83725:0:(file.c:424:ll_file_release()) START file d61b.sanity-flr:[0x200000405:0x49:0x0](ffff9cfe0edc0908), flags 704000 00010000:00010000:1.0:1767316903.971864:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5718d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x49:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adea9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.971997:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.972015:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.972024:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.972032:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.972039:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.972044:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.972048:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57178 00000080:00010000:1.0:1767316903.972054:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57178 from it ffffa99f40d87c10 00010000:00010000:1.0:1767316903.972058:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.972066:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.972115:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.972132:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d61b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=0 00000080:00200000:1.0:1767316903.972137:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d61b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316903.972151:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d61b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.972211:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.972219:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.972235:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.972255:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894115200:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.972338:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.975502:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894115200:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.975528:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.975545:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 4/1,0 mode: --/PR res: [0x200000405:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.975553:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 4/1,0 mode: --/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.975574:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.975584:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.975595:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.975601:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.975608:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.975632:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558d880 x1853163894115200/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.975645:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.975654:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/73 (0 0) 00000080:00200000:1.0:1767316903.975661:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316903.975681:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x49:0x0], updating i_size 4096 00000080:00200000:1.0:1767316903.975684:0:83725:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x49:0x0](ffff9cfe0edc0908): rc = 0 00000080:00010000:1.0:1767316903.975690:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x49:0x0](ffff9cfe0edc0908) for lock 0xd9a0da65fad5719b 00000080:00010000:1.0:1767316903.975701:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x49:0x0](ffff9cfe0edc0908) 00000080:00010000:1.0:1767316903.975704:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5719b from it ffffa99f40d87e00 00010000:00010000:1.0:1767316903.975708:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.975717:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.975752:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.975774:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.975783:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.975793:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.975799:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.975809:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.975824:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57178 00000080:00010000:1.0:1767316903.975829:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57178 from it ffffa99f40d87d88 00010000:00010000:1.0:1767316903.975832:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.975839:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.975848:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316903.975856:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d61b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316903.975880:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.976002:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adf04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.976016:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5718d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x49:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adea9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.976057:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0558d500 x1853163894114560/t8589937555(8589937555) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316903.976068:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316903.976073:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558d880 x1853163894115456/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316903.976121:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894115456:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316903.976370:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.979482:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894115456:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316903.979532:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0558d500 x1853163894114560/t8589937555(8589937555) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767316903.979687:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 1/0,0 mode: --/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adf04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.979697:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5718d lrc: 1/0,0 mode: --/CR res: [0x200000405:0x49:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adea9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.979703:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.979709:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1767316903.979712:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5719b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adf04 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.979723:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5718d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x49:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adea9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.979735:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57178 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ade71 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316903.979754:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316903.979760:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558d880 x1853163894115712/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316903.979782:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894115712:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316903.979921:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.984629:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894115712:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316903.984675:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x49:0x0](ffff9cfe0edc0908) 00000080:00200000:1.0:1767316903.984770:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.984793:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.984874:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.984885:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.985004:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.985030:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894115840:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.985463:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.989386:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894115840:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.989412:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.989424:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.989436:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.989447:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.989459:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.989466:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.989490:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.989502:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558d500 x1853163894115840/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.989517:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.989530:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316903.989536:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316903.989632:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316903.989641:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad571a2 00000080:00010000:1.0:1767316903.989647:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316903.989650:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571a2 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316903.989654:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.989662:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.989689:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316903.989709:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d61c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316903.989713:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d61c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316903.989735:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d61c.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.989775:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.989793:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.989803:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.989834:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894115968:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.990056:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.994059:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894115968:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.994108:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.994130:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.994138:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.994149:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.994159:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.994171:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.994177:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.994329:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.994343:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558d500 x1853163894115968/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.994354:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.994364:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 9663677445/23 (0 0) 00000002:00010000:1.0:1767316903.994380:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000405:0x17:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.994429:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.994436:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316903.994443:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316903.994463:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894116096:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316903.994588:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316903.997801:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894116096:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316903.997838:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.997850:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.997880:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.997890:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.997994:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.998001:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.998007:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316903.998018:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558ce00 x1853163894116096/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/584 e 0 to 0 dl 1767316919 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316903.998029:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.998041:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/23 (0 0) 00000080:00200000:1.0:1767316903.998062:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316903.998137:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000405:0x17:0x0](ffff9cfe0ed99148) 00000080:00200000:1.0:1767316903.998145:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x17:0x0], updating i_size 4096 00000080:00010000:1.0:1767316903.998152:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000405:0x17:0x0](ffff9cfe0ed99148) for remote lock 0xd9a0da65fad571b0 00000080:00010000:1.0:1767316903.998157:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x17:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad571a9 00000080:00010000:1.0:1767316903.998169:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x17:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316903.998177:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571a9 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316903.999447:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.999463:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767316903.999478:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad571b0 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316903.999483:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.999491:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316903.999700:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d61c.sanity-flr:[0x240000405:0x17:0x0](ffff9cfe0ed99148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316903.999710:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0x17:0x0](ffff9cfe0ed99148),name=d61c.sanity-flr 00000002:00010000:1.0:1767316903.999737:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x17:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.999749:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.999760:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.999766:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316903.999772:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x17:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316903.999775:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x17:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad571b0 00000080:00010000:1.0:1767316903.999779:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571b0 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316903.999782:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.999803:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.999870:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316903.999880:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316903.999888:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316903.999990:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316903.999997:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.000001:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.000004:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad571a2 00000080:00010000:1.0:1767316904.000008:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571a2 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316904.000011:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.000018:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.000028:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.000034:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d61c.sanity-flr, flags=266 00000080:00200000:1.0:1767316904.000040:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x17:0x0](ffff9cfe0ed99148), inode mode 41ed mask 44 00000100:00100000:1.0:1767316904.000137:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894116224:192.168.202.121@tcp:49:rm.0 00000100:00100000:1.0:1767316904.000514:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.004069:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894116224:192.168.202.121@tcp:49:rm.0 00000080:00200008:1.0:1767316904.004447:0:83725:0:(file.c:1001:ll_file_open()) START file d61c.sanity-flr:[0x240000405:0x17:0x0](ffff9cfe0ed99148), flags 704400 00000002:00010000:1.0:1767316904.004654:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x17:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767316904.004726:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.004736:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316904.004748:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316904.004757:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558ce00 x1853163894116480/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316904.004767:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.004787:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894116480:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.005023:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316904.005318:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.008844:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894116480:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.008869:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571b7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.008881:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571b7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.008887:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571b7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.008983:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571b7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.008992:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571b7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.009015:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2cc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316904.009020:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571b7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.009027:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571b7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.009033:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571b7 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.009040:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316904.009047:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571b7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.009053:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:1.0:1767316904.009158:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe0558ce00 x1853163894116480/t4294975983(4294975983) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316904.009174:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558ce00 x1853163894116480/t4294975983(4294975983) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316904.009197:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316904.009220:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x17:0x0], updating i_size 4096 00000002:00100000:1.0:1767316904.009239:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558ce00 x1853163894116480/t4294975983(4294975983) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316904.009302:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d61c.sanity-flr:[0x240000405:0x17:0x0](ffff9cfe0ed99148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.009309:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0x17:0x0](ffff9cfe0ed99148),name=d61c.sanity-flr 00000002:00010000:1.0:1767316904.009331:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x17:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.009349:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.009362:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.009369:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.009375:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x17:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316904.009379:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x17:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad571b0 00000080:00010000:1.0:1767316904.009384:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571b0 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316904.009387:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.009395:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.009425:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0x17:0x0](ffff9cfe0ed99148) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1767316904.009437:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x17:0x0]) in obj [0x240000405:0x17:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316904.009443:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.009452:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316904.010077:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894116608:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316904.010217:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.015954:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894116608:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316904.016912:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.016942:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316904.017006:0:83725:0:(file.c:424:ll_file_release()) START file d61c.sanity-flr:[0x240000405:0x17:0x0](ffff9cfe0ed99148), flags 704000 00000002:00100000:1.0:1767316904.017075:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0558ce00 x1853163894116480/t4294975983(4294975983) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316920 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316904.017119:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316904.017125:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558d500 x1853163894116864/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316904.017151:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894116864:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316904.017252:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.020045:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894116864:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316904.020113:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0558ce00 x1853163894116480/t4294975983(4294975983) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316904.020197:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.020216:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.020231:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.020245:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.020253:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.020258:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.020262:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad571a2 00000080:00010000:1.0:1767316904.020280:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571a2 from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316904.020284:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.020292:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.020306:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.020313:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d61c.sanity-flr, flags=266 00000080:00200000:1.0:1767316904.020320:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x17:0x0](ffff9cfe0ed99148), inode mode 41ed mask 44 00000100:00100000:1.0:1767316904.020364:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894116992:192.168.202.121@tcp:49:rm.0 00000100:00100000:1.0:1767316904.020440:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.022861:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894116992:192.168.202.121@tcp:49:rm.0 00000080:00200008:1.0:1767316904.022913:0:83725:0:(file.c:1001:ll_file_open()) START file d61c.sanity-flr:[0x240000405:0x17:0x0](ffff9cfe0ed99148), flags 704400 00000002:00010000:1.0:1767316904.022944:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x17:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767316904.023003:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.023012:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316904.023023:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316904.023030:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558d500 x1853163894117248/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316904.023039:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.023058:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894117248:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.023287:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.026441:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894117248:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.026491:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571be lrc: 4/1,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf6d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.026502:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571be lrc: 4/1,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf6d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.026514:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571be lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf6d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.026525:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571be lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf6d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.026540:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe0558d500 x1853163894117248/t4294975985(4294975985) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316904.026551:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558d500 x1853163894117248/t4294975985(4294975985) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.026571:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571be lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf6d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.026581:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 16 res 9663677445/23 (0 0) 00000080:00200000:1.0:1767316904.026589:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316904.026609:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x17:0x0], updating i_size 4096 00000080:00010000:1.0:1767316904.026614:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x17:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad571be 00000080:00010000:1.0:1767316904.026622:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571be from it ffffa99f40d87bd0 00010000:00010000:1.0:1767316904.026626:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571be lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf6d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.026650:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571be lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf6d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.026681:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558d500 x1853163894117248/t4294975985(4294975985) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316904.026746:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d61c.sanity-flr:[0x240000405:0x17:0x0](ffff9cfe0ed99148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.026753:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0x17:0x0](ffff9cfe0ed99148),name=d61c.sanity-flr 00000002:00010000:1.0:1767316904.026775:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x17:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.026784:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.026794:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.026801:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.026806:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x17:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316904.026810:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x17:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad571b0 00000080:00010000:1.0:1767316904.026824:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571b0 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316904.026828:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.026835:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.026869:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0x17:0x0](ffff9cfe0ed99148) pos/size0/4096 32bit_api 0 00000080:00200000:1.0:1767316904.026892:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0x17:0x0](ffff9cfe0ed99148) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1767316904.026914:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x17:0x0](ffff9cfe0ed99148), inode mode 41ed mask 1 00000100:00100000:1.0:1767316904.026966:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894117376:192.168.202.121@tcp:49:rm.0 00000100:00100000:1.0:1767316904.027051:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.030180:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894117376:192.168.202.121@tcp:49:rm.0 00000080:00200000:1.0:1767316904.030249:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f61c.sanity-flr, dir=[0x240000405:0x17:0x0](ffff9cfe0ed99148), flags=0 00000080:00200000:1.0:1767316904.030255:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f61c.sanity-flr, dir=[0x240000405:0x17:0x0](ffff9cfe0ed99148), intent=getattr 00000002:00010000:1.0:1767316904.030285:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f61c.sanity-flr,[0x0:0x0:0x0]) in obj [0x240000405:0x17:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.030339:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.030349:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.030358:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.030380:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894117504:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.030514:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.036699:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894117504:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.036727:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf90 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.036752:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf90 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.036759:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf90 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.036770:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf90 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.036795:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf90 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.036808:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf90 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.036831:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf90 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.036837:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf90 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.036848:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558ce00 x1853163894117504/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/824 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.036860:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf90 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.036872:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf90 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.036884:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/24 (0 0) 00000080:00200000:1.0:1767316904.036892:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000405:0x17:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316904.036934:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000405:0x18:0x0](ffff9cfe0ed9b248) 00000080:00200000:1.0:1767316904.037001:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x18:0x0], updating i_size 7 00000080:00200000:1.0:1767316904.037026:0:83725:0:(file.c:6809:ll_layout_conf()) [0x240000405:0x18:0x0]: layout version change: 4294967294 -> 7 00000080:00010000:1.0:1767316904.037032:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x18:0x0](ffff9cfe0ed9b248) for lock 0xd9a0da65fad571c5 00000080:00010000:1.0:1767316904.037042:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x18:0x0](ffff9cfe0ed9b248) 00000080:00010000:1.0:1767316904.037053:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571c5 from it ffffa99f40d87df8 00010000:00010000:1.0:1767316904.037057:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655adf90 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.037066:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655adf90 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.037159:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x17:0x0](ffff9cfe0ed99148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316904.037172:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f61c.sanity-flr, dir=[0x240000405:0x17:0x0](ffff9cfe0ed99148) 00010000:00010000:1.0:1767316904.037304:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.037400:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655adf90 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.037411:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x240000405:0x18:0x0]: losing layout lock 00010000:00010000:1.0:1767316904.037535:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655adf90 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.037544:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.037549:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316904.037552:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571c5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655adf90 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.037567:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571b0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adf51 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316904.037583:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316904.037590:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558ce00 x1853163894117760/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316904.037625:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894117760:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316904.037931:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.042553:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ce00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894117760:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316904.043487:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x240000405:0x18:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316904.043499:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x240000405:0x18:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316904.043502:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316904.043510:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316904.043542:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x240000405:0x18:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.043551:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000405:0x18:0x0](ffff9cfe0ed9b248) 00000080:00200008:1.0:1767316904.043802:0:83725:0:(file.c:424:ll_file_release()) START file d61c.sanity-flr:[0x240000405:0x17:0x0](ffff9cfe0ed99148), flags 704000 00010000:00010000:1.0:1767316904.043841:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571be lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf6d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.043889:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.043998:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.044010:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.044021:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.044028:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.044034:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.044039:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad571a2 00000080:00010000:1.0:1767316904.044046:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571a2 from it ffffa99f40d87c10 00010000:00010000:1.0:1767316904.044050:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.044075:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.044221:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.044240:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d61c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=0 00000080:00200000:1.0:1767316904.044245:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d61c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316904.044260:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d61c.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.044319:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.044327:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.044337:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.044368:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ed80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894117888:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.044481:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.050809:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ed80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894117888:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.050849:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.050866:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 4/1,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.050873:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 4/1,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.050896:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.050907:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.050918:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.050926:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.050932:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.050942:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558ed80 x1853163894117888/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.050953:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.050962:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.050973:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.050979:0:83725:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.050995:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.051002:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.051028:0:83725:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000002:00010000:1.0:1767316904.051046:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000405:0x17:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.051126:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.051134:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.051142:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.051164:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894118016:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.051249:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00010000:00010000:2.0:1767316904.051444:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1767316904.051452:0:59093:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.051460:0:59093:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2dc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:2.0:1767316904.051466:0:59093:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.051474:0:59093:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.051482:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.051499:0:59093:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.051527:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 2/0,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.051533:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767316904.051561:0:59093:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 1/0,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.051569:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad571cc lrc: 0/0,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adfc8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.051581:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316904.051590:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316904.051593:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316904.051602:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767316904.051618:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894118144:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316904.058448:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894118016:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.058479:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adfd6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.058492:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adfd6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.058503:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adfd6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.058529:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adfd6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.058543:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adfd6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.058551:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adfd6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.058559:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adfd6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.058570:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558f100 x1853163894118016/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/584 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.058583:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adfd6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.058594:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/23 (0 0) 00000080:00200000:1.0:1767316904.058614:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316904.058634:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x17:0x0], updating i_size 4096 00000080:00200000:1.0:1767316904.058638:0:83725:0:(namei.c:151:ll_iget()) got inode: [0x240000405:0x17:0x0](ffff9cfe0ed99148): rc = 0 00000080:00010000:1.0:1767316904.058644:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000405:0x17:0x0](ffff9cfe0ed99148) for remote lock 0xd9a0da65fad571d3 00000080:00010000:1.0:1767316904.058649:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x17:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad571a9 00000080:00010000:1.0:1767316904.058658:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x17:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316904.058661:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571a9 from it ffffa99f40d87e00 00010000:00010000:1.0:1767316904.058665:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.058683:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767316904.058695:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad571d3 from it ffffa99f40d87e00 00010000:00010000:1.0:1767316904.058697:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adfd6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.058702:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adfd6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.058720:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.058737:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.058745:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.058752:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.058757:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.058759:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.058762:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad571a2 00000080:00010000:1.0:1767316904.058764:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571a2 from it ffffa99f40d87d88 00010000:00010000:1.0:1767316904.058766:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.058770:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.058782:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316904.058789:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d61c.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316904.058804:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.058859:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.058867:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316904.058894:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571a9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adf43 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.058923:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adfd6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.058938:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571be lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655adf6d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.058973:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0558d500 x1853163894117248/t4294975985(4294975985) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316920 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316904.058983:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316904.058988:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558ed80 x1853163894118528/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316904.059005:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ed80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894118528:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316904.059120:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.059567:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894118272:192.168.202.121@tcp:103:rm.0 00000100:00100000:2.0:1767316904.060037:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894118144:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316904.064726:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ed80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894118528:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316904.064774:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0558d500 x1853163894117248/t4294975985(4294975985) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/608 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1767316904.064850:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adfd6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.064858:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571be lrc: 1/0,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adf6d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.064862:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316904.064864:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571d3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adfd6 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.064871:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571be lrc: 0/0,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655adf6d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316904.064886:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316904.064890:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558ed80 x1853163894118784/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316904.064911:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558ed80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894118784:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316904.064989:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.065060:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894118272:192.168.202.121@tcp:103:rm.0 00000100:00100000:3.0:1767316904.069522:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316904.069618:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939838080 00000100:00100000:2.0:1767316904.069642:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939838080 00000100:00100000:2.0:1767316904.069696:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10259 00000100:00100000:2.0:1767316904.069706:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939838080:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316904.069723:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.069798:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316904.069805:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939838080:12345-192.168.202.121@tcp:104: Request processed in 101us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316904.069821:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10259 00010000:00010000:0.0:1767316904.069886:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316904.069893:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.069902:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2ce00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316904.069907:0:42049:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.069916:0:42049:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.069924:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.069984:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.069990:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316904.070021:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.070028:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad571a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655adf27 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.070062:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316904.070064:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316904.070066:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316904.070075:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316904.070133:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894118912:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316904.075028:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894118912:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316904.089316:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558ed80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894118784:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316904.089367:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000405:0x17:0x0](ffff9cfe0ed99148) 00000080:00200000:1.0:1767316904.089458:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.089479:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.089542:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.089552:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.089581:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.089602:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894119040:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.089705:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.096001:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894119040:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.096028:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.096040:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.096051:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.096062:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.096073:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.096100:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.096107:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.096117:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558d500 x1853163894119040/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.096147:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.096160:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316904.096178:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316904.096324:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316904.096331:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad571da 00000080:00010000:1.0:1767316904.096337:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.096339:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571da from it ffffa99f40d87b58 00010000:00010000:1.0:1767316904.096342:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.096350:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.096376:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.096396:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d62.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316904.096400:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d62.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316904.096422:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d62.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.096464:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.096471:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.096479:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.096499:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894119168:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.096656:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.100374:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894119168:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.100399:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.100420:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.100428:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.100439:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.100450:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.100463:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.100471:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.100478:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.100489:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558d500 x1853163894119168/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.100501:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.100528:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/78 (0 0) 00000080:00200000:1.0:1767316904.100535:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316904.100577:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x4e:0x0](ffff9cfe0ed99148) 00000080:00200000:1.0:1767316904.100586:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x4e:0x0], updating i_size 4096 00000080:00010000:1.0:1767316904.100593:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4e:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad571e1 00000080:00010000:1.0:1767316904.100603:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4e:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316904.100607:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571e1 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316904.100611:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.100619:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316904.100661:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d62.sanity-flr:[0x200000405:0x4e:0x0](ffff9cfe0ed99148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.100668:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x4e:0x0](ffff9cfe0ed99148),name=d62.sanity-flr 00000002:00010000:1.0:1767316904.100690:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.100697:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.100707:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.100713:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.100718:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4e:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316904.100721:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4e:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad571e1 00000080:00010000:1.0:1767316904.100725:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571e1 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316904.100728:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.100741:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.100795:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.100803:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.100821:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.100830:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.100836:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.100841:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.100844:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad571da 00000080:00010000:1.0:1767316904.100847:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571da from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316904.100850:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.100857:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.100865:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.100871:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d62.sanity-flr, flags=266 00000080:00200000:1.0:1767316904.100876:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4e:0x0](ffff9cfe0ed99148), inode mode 41ed mask 44 00000080:00200008:1.0:1767316904.100885:0:83725:0:(file.c:1001:ll_file_open()) START file d62.sanity-flr:[0x200000405:0x4e:0x0](ffff9cfe0ed99148), flags 704400 00000002:00010000:1.0:1767316904.100900:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767316904.100947:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.100958:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316904.100971:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316904.100978:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558d500 x1853163894119424/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316904.100986:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.101004:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894119424:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.101498:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.108142:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894119424:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.108178:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571e8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.108199:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571e8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.108205:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571e8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.108211:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571e8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.108218:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571e8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.108224:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316904.108228:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571e8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.108251:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571e8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.108258:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571e8 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.108264:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316904.108270:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571e8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.108275:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:1.0:1767316904.108294:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe0558d500 x1853163894119424/t8589937560(8589937560) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316904.108306:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558d500 x1853163894119424/t8589937560(8589937560) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316904.108317:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316904.108336:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x4e:0x0], updating i_size 4096 00000002:00100000:1.0:1767316904.108356:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558d500 x1853163894119424/t8589937560(8589937560) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316904.108419:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d62.sanity-flr:[0x200000405:0x4e:0x0](ffff9cfe0ed99148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.108427:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x4e:0x0](ffff9cfe0ed99148),name=d62.sanity-flr 00000002:00010000:1.0:1767316904.108448:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.108464:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.108476:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.108489:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.108495:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4e:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316904.108499:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4e:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad571e1 00000080:00010000:1.0:1767316904.108504:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571e1 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316904.108508:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.108516:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.108547:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x4e:0x0](ffff9cfe0ed99148) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1767316904.108575:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4e:0x0]) in obj [0x200000405:0x4e:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316904.108582:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.108590:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316904.109267:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894119552:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316904.109369:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.118440:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894119552:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316904.119326:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.119343:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316904.119428:0:83725:0:(file.c:424:ll_file_release()) START file d62.sanity-flr:[0x200000405:0x4e:0x0](ffff9cfe0ed99148), flags 704000 00000002:00100000:1.0:1767316904.119491:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0558d500 x1853163894119424/t8589937560(8589937560) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316920 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316904.119502:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316904.119508:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558f100 x1853163894119808/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316904.119530:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894119808:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316904.119853:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.123452:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894119808:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316904.123490:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0558d500 x1853163894119424/t8589937560(8589937560) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316904.123720:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.123741:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.123759:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.123772:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.123779:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.123785:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.123788:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad571da 00000080:00010000:1.0:1767316904.123794:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571da from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316904.123798:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.123831:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.123848:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.123855:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d62.sanity-flr, flags=266 00000080:00200000:1.0:1767316904.123865:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4e:0x0](ffff9cfe0ed99148), inode mode 41ed mask 44 00000080:00200008:1.0:1767316904.123874:0:83725:0:(file.c:1001:ll_file_open()) START file d62.sanity-flr:[0x200000405:0x4e:0x0](ffff9cfe0ed99148), flags 704400 00000002:00010000:1.0:1767316904.123890:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1767316904.124044:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.124052:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316904.124063:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316904.124071:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558f100 x1853163894120064/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316904.124264:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.124294:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894120064:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.124540:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.129847:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894120064:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.129883:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571ef lrc: 4/1,0 mode: --/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae04d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.129907:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571ef lrc: 4/1,0 mode: --/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae04d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.129932:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571ef lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae04d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.129942:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571ef lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae04d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.129957:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe0558f100 x1853163894120064/t8589937562(8589937562) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316904.129970:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558f100 x1853163894120064/t8589937562(8589937562) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.129981:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571ef lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae04d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.129992:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/78 (0 0) 00000080:00200000:1.0:1767316904.129999:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316904.130021:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x4e:0x0], updating i_size 4096 00000080:00010000:1.0:1767316904.130027:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4e:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad571ef 00000080:00010000:1.0:1767316904.130034:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571ef from it ffffa99f40d87bd0 00010000:00010000:1.0:1767316904.130038:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571ef lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae04d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.130048:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571ef lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae04d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.130073:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0558f100 x1853163894120064/t8589937562(8589937562) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316904.130442:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d62.sanity-flr:[0x200000405:0x4e:0x0](ffff9cfe0ed99148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.130452:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x4e:0x0](ffff9cfe0ed99148),name=d62.sanity-flr 00000002:00010000:1.0:1767316904.130474:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x4e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.130485:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.130497:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.130504:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.130510:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4e:0x0](ffff9cfe0ed99148) 00000080:00010000:1.0:1767316904.130513:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4e:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad571e1 00000080:00010000:1.0:1767316904.130517:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571e1 from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316904.130520:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.130527:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.130620:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x4e:0x0](ffff9cfe0ed99148) pos/size0/4096 32bit_api 0 00000080:00200000:1.0:1767316904.130647:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x4e:0x0](ffff9cfe0ed99148) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1767316904.130669:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4e:0x0](ffff9cfe0ed99148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.130686:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f62.sanity-flr, dir=[0x200000405:0x4e:0x0](ffff9cfe0ed99148), flags=0 00000080:00200000:1.0:1767316904.130691:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f62.sanity-flr, dir=[0x200000405:0x4e:0x0](ffff9cfe0ed99148), intent=getattr 00000002:00010000:1.0:1767316904.130703:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f62.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000405:0x4e:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.130746:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.130758:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.130769:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.130791:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894120192:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.131528:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.136470:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894120192:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.136499:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae070 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.136526:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae070 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.136535:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae070 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.136546:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae070 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.136558:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae070 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.136580:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae070 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.136589:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae070 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.136617:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae070 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.136630:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0558d500 x1853163894120192/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/824 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.136641:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae070 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.136654:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae070 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.136665:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/81 (0 0) 00000080:00200000:1.0:1767316904.136674:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x4e:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316904.136705:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x51:0x0](ffff9cfe0ed9b248) 00000080:00200000:1.0:1767316904.136780:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x51:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1767316904.136786:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x51:0x0](ffff9cfe0ed9b248) for lock 0xd9a0da65fad571f6 00000080:00010000:1.0:1767316904.136794:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x51:0x0](ffff9cfe0ed9b248) 00000080:00010000:1.0:1767316904.136797:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571f6 from it ffffa99f40d87df8 00010000:00010000:1.0:1767316904.136800:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae070 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.136808:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae070 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.136853:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x4e:0x0](ffff9cfe0ed99148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316904.136861:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f62.sanity-flr, dir=[0x200000405:0x4e:0x0](ffff9cfe0ed99148) 00010000:00010000:1.0:1767316904.136894:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.136918:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571ef lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae04d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.136984:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae070 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.136995:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x51:0x0]: losing layout lock 00010000:00010000:1.0:1767316904.137023:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae070 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.137030:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.137035:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316904.137037:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad571f6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae070 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.137050:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad571e1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae031 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316904.137064:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316904.137071:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558d500 x1853163894120448/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316904.137533:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894120448:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316904.137626:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.141948:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558d500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894120448:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316904.142005:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x51:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316904.142032:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x51:0x0]: flr state: 2, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316904.142036:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316904.142042:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x16 00000080:00200000:1.0:1767316904.142070:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x51:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.142077:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x51:0x0](ffff9cfe0ed9b248) 00000080:00200008:1.0:1767316904.142839:0:83725:0:(file.c:424:ll_file_release()) START file d62.sanity-flr:[0x200000405:0x4e:0x0](ffff9cfe0ed99148), flags 704000 00010000:00010000:1.0:1767316904.142868:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571ef lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae04d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.143001:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.143020:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.143030:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.143039:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.143046:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.143053:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.143056:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad571da 00000080:00010000:1.0:1767316904.143063:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571da from it ffffa99f40d87c10 00010000:00010000:1.0:1767316904.143066:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.143074:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.143612:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.144477:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d62.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=0 00000080:00200000:0.0:1767316904.144484:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d62.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316904.144509:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d62.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.144577:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.144586:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.144596:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.144624:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894120576:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.144724:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.147473:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894120576:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.147498:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0a8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.147513:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 4/1,0 mode: --/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0a8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.147541:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 4/1,0 mode: --/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0a8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.147552:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0a8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.147573:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0a8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.147586:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0a8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.147594:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0a8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.147601:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0a8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.147613:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11320000 x1853163894120576/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.147626:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0a8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.147637:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/78 (0 0) 00000080:00200000:0.0:1767316904.147644:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.147665:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x4e:0x0], updating i_size 4096 00000080:00200000:0.0:1767316904.147668:0:83725:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x4e:0x0](ffff9cfe0ed99148): rc = 0 00000080:00010000:0.0:1767316904.147674:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x4e:0x0](ffff9cfe0ed99148) for lock 0xd9a0da65fad571fd 00000080:00010000:0.0:1767316904.147691:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x4e:0x0](ffff9cfe0ed99148) 00000080:00010000:0.0:1767316904.147695:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571fd from it ffffa99f40d87e00 00010000:00010000:0.0:1767316904.147699:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0a8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.147707:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0a8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.147739:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.147756:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.147765:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.147775:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.147781:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.147785:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.147788:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad571da 00000080:00010000:0.0:1767316904.147791:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad571da from it ffffa99f40d87d88 00010000:00010000:0.0:1767316904.147794:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.147800:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.147808:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316904.147825:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d62.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316904.147847:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.147876:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae0a8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.147887:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571ef lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae04d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.147943:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0558f100 x1853163894120064/t8589937562(8589937562) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316920 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316904.147953:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316904.147959:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11320000 x1853163894120832/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316904.147983:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894120832:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316904.148066:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.151633:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894120832:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316904.151670:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0558f100 x1853163894120064/t8589937562(8589937562) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/608 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767316904.151760:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 1/0,0 mode: --/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae0a8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.151770:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571ef lrc: 1/0,0 mode: --/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae04d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.151777:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.151783:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1767316904.151801:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad571fd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae0a8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.151823:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad571ef lrc: 0/0,0 mode: --/CR res: [0x200000405:0x4e:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae04d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.151837:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad571da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae015 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316904.151860:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316904.151868:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11320000 x1853163894121088/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316904.151892:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894121088:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316904.151998:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.157545:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894121088:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.157602:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x4e:0x0](ffff9cfe0ed99148) 00000080:00200000:0.0:1767316904.157677:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.157701:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.157760:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.157769:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.157778:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.157800:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894121216:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.157901:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.161787:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894121216:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.161825:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.161837:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.161849:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.161859:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.161870:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.161879:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.161887:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.161909:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11323480 x1853163894121216/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.161922:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.161935:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316904.161943:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.161983:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.161989:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57204 00000080:00010000:0.0:1767316904.161995:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.161998:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57204 from it ffffa99f40d87b58 00010000:00010000:0.0:1767316904.162001:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.162010:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.162032:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.162050:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d70a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316904.162055:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d70a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316904.162109:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d70a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.162147:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.162154:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.162277:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.162297:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894121344:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.162376:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.166842:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894121344:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.166870:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.166970:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 4/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.166994:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 4/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.167005:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.167015:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.167029:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.167036:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.167043:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.167054:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11323480 x1853163894121344/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/672 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.167068:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.167400:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/84 (0 0) 00000080:00200000:0.0:1767316904.167412:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.167455:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x54:0x0](ffff9cfe0edc1148) 00000002:00010000:0.0:1767316904.167487:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.167538:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.167553:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.167703:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.167726:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894121472:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.167884:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.170938:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894121472:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.170962:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.170974:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.170985:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.170995:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.171006:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.171013:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.171022:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.171055:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11321c00 x1853163894121472/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.171069:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.171100:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589937616/6 (0 0) 00010000:00010000:0.0:1767316904.171108:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.171116:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.171144:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x6:0x0]) in obj [0x240000406:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.171214:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.171220:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.171228:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.171247:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894121600:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.171604:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.174732:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894121600:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.174754:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 4/1,0 mode: --/CR res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.174785:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 4/1,0 mode: --/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.174796:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.174807:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.174828:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.174836:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.174844:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.174855:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11321c00 x1853163894121600/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.174869:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.174882:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677446/6 (0 0) 00010000:00010000:0.0:1767316904.174889:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.174974:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.175011:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x54:0x0], updating i_size 8192 00000080:00010000:0.0:1767316904.175021:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x54:0x0](ffff9cfe0edc1148) for lock 0xd9a0da65fad5720b 00000080:00010000:0.0:1767316904.175033:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x54:0x0](ffff9cfe0edc1148) 00000080:00010000:0.0:1767316904.175036:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5720b from it ffffa99f40d87b20 00010000:00010000:0.0:1767316904.175040:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175047:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316904.175074:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d70a.sanity-flr:[0x200000405:0x54:0x0](ffff9cfe0edc1148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.175100:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x54:0x0](ffff9cfe0edc1148),name=d70a.sanity-flr 00000002:00010000:0.0:1767316904.175120:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x54:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.175128:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175138:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.175145:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.175150:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175157:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175354:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175370:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.175380:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x6:0x0]) in obj [0x240000406:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.175385:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175393:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175401:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175408:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.175416:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316904.175422:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x54:0x0](ffff9cfe0edc1148) 00000080:00010000:0.0:1767316904.175425:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x54:0x0](ffff9cfe0edc1148) for lock 0xd9a0da65fad5720b 00000080:00010000:0.0:1767316904.175428:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5720b from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316904.175431:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175437:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.175449:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.175455:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175469:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175477:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175484:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.175494:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x6:0x0]) in obj [0x240000406:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.175499:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175506:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175513:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175519:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.175652:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.175664:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.175672:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175680:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.175696:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.175700:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.175703:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57204 00000080:00010000:0.0:1767316904.175708:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57204 from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316904.175711:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.175718:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.175726:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.175732:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70a.sanity-flr, flags=266 00000080:00200000:0.0:1767316904.175737:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x54:0x0](ffff9cfe0edc1148), inode mode 41ed mask 44 00000080:00200008:0.0:1767316904.175745:0:83725:0:(file.c:1001:ll_file_open()) START file d70a.sanity-flr:[0x200000405:0x54:0x0](ffff9cfe0edc1148), flags 704400 00000002:00010000:0.0:1767316904.175762:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x54:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316904.175821:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57220 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.175828:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57220 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316904.175840:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316904.175848:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11323480 x1853163894121856/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316904.175858:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57220 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.175880:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894121856:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.176776:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.181025:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894121856:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.181051:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57220 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.181065:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57220 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.181071:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57220 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.181098:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57220 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.181107:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57220 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.181113:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c600 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316904.181117:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57220 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.181124:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57220 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.181130:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57220 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.181136:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316904.181143:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57220 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.181149:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57220 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316904.181316:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe11323480 x1853163894121856/t8589937566(8589937566) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316904.181329:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11323480 x1853163894121856/t8589937566(8589937566) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316904.181345:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.181378:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x54:0x0], updating i_size 4096 00000002:00100000:0.0:1767316904.181396:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11323480 x1853163894121856/t8589937566(8589937566) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316904.181466:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d70a.sanity-flr:[0x200000405:0x54:0x0](ffff9cfe0edc1148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.181473:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x54:0x0](ffff9cfe0edc1148),name=d70a.sanity-flr 00000002:00010000:0.0:1767316904.181493:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x54:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.181507:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.181519:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.181528:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.181534:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.181541:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.181549:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.181643:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.181658:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x6:0x0]) in obj [0x240000406:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.181666:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.181674:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.181681:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.181687:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.181696:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316904.181701:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x54:0x0](ffff9cfe0edc1148) 00000080:00010000:0.0:1767316904.181705:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x54:0x0](ffff9cfe0edc1148) for lock 0xd9a0da65fad5720b 00000080:00010000:0.0:1767316904.181709:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5720b from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316904.181712:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.181718:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.181729:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.181733:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.181749:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.181756:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.181762:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.181770:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x6:0x0]) in obj [0x240000406:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.181774:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.181782:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.181788:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.181794:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.181835:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x54:0x0](ffff9cfe0edc1148) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767316904.181848:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.181873:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316904.181879:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.181992:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316904.182930:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894121984:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316904.183037:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.189879:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894121984:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316904.191004:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.191021:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.191044:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x6:0x0]) in obj [0x240000406:0x6:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316904.191058:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.191071:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316904.191847:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894122112:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316904.192180:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.199941:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894122112:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316904.200677:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.200693:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316904.200778:0:83725:0:(file.c:424:ll_file_release()) START file d70a.sanity-flr:[0x200000405:0x54:0x0](ffff9cfe0edc1148), flags 704000 00000002:00100000:0.0:1767316904.200851:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe11323480 x1853163894121856/t8589937566(8589937566) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316920 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316904.200863:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316904.200868:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11321c00 x1853163894122368/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316904.200892:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894122368:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316904.201056:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.206580:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894122368:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316904.206617:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe11323480 x1853163894121856/t8589937566(8589937566) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316904.206695:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.206715:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.206731:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.206745:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.206753:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.206758:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.206762:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57204 00000080:00010000:0.0:1767316904.206769:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57204 from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316904.206773:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.206796:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.206825:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.206834:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70a.sanity-flr, flags=266 00000080:00200000:0.0:1767316904.206842:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x54:0x0](ffff9cfe0edc1148), inode mode 41ed mask 44 00000080:00200008:0.0:1767316904.206851:0:83725:0:(file.c:1001:ll_file_open()) START file d70a.sanity-flr:[0x200000405:0x54:0x0](ffff9cfe0edc1148), flags 704400 00000002:00010000:0.0:1767316904.206869:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x54:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1767316904.206935:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57227 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.206943:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57227 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316904.206957:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316904.206963:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11321c00 x1853163894122624/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316904.206972:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57227 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.206992:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894122624:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.207414:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.211457:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894122624:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.211490:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57227 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae11f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211500:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57227 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae11f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211526:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57227 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae11f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211537:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57227 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae11f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.211554:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe11321c00 x1853163894122624/t8589937568(8589937568) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316904.211576:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11321c00 x1853163894122624/t8589937568(8589937568) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.211592:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57227 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae11f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211603:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 16 res 8589935621/84 (0 0) 00000080:00200000:0.0:1767316904.211609:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.211641:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x54:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.211648:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x54:0x0](ffff9cfe0edc1148) for lock 0xd9a0da65fad57227 00000080:00010000:0.0:1767316904.211655:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57227 from it ffffa99f40d87bd0 00010000:00010000:0.0:1767316904.211659:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57227 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae11f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211668:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57227 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae11f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.211692:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11321c00 x1853163894122624/t8589937568(8589937568) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316904.211767:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d70a.sanity-flr:[0x200000405:0x54:0x0](ffff9cfe0edc1148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.211774:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x54:0x0](ffff9cfe0edc1148),name=d70a.sanity-flr 00000002:00010000:0.0:1767316904.211795:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x54:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.211805:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211826:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.211836:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.211843:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211851:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211859:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211865:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.211874:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x6:0x0]) in obj [0x240000406:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.211881:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211888:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211918:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211925:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.211936:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316904.211941:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x54:0x0](ffff9cfe0edc1148) 00000080:00010000:0.0:1767316904.211945:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x54:0x0](ffff9cfe0edc1148) for lock 0xd9a0da65fad5720b 00000080:00010000:0.0:1767316904.211949:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5720b from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316904.211952:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211958:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.211969:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.211975:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211983:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211990:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.211996:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.212015:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x6:0x0]) in obj [0x240000406:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.212021:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.212028:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.212036:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.212042:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.212075:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x54:0x0](ffff9cfe0edc1148) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767316904.212117:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.212140:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x6:0x0]) in obj [0x200000bd0:0x6:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316904.212147:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.212154:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767316904.212533:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767316904.212539:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.212547:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.212627:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x6:0x0]) in obj [0x240000406:0x6:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316904.212634:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.212643:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767316904.212653:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767316904.212656:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.212662:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.212703:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x54:0x0](ffff9cfe0edc1148) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:0.0:1767316904.212726:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x54:0x0](ffff9cfe0edc1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.212743:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f70a.sanity-flr.fsxlog, dir=[0x200000405:0x54:0x0](ffff9cfe0edc1148), flags=0 00000080:00200000:0.0:1767316904.212748:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f70a.sanity-flr.fsxlog, dir=[0x200000405:0x54:0x0](ffff9cfe0edc1148), intent=getattr 00000002:00010000:0.0:1767316904.212762:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f70a.sanity-flr.fsxlog,[0x0:0x0:0x0]) in obj [0x240000406:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.212806:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 3/1,0 mode: --/CR res: [0x240000406:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.212824:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 3/1,0 mode: --/CR res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.212834:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 3/1,0 mode: --/CR res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.212855:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894122752:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.213138:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.216696:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894122752:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.216721:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 4/1,0 mode: --/CR res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae142 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.216744:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae142 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.216751:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae142 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.216762:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae142 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.216772:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae142 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.216782:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae142 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.216790:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae142 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.216798:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae142 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.216808:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11323480 x1853163894122752/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/640 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.216832:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae142 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.216858:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae142 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.216869:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/422 (0 0) 00000080:00200000:0.0:1767316904.216876:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000406:0x6:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.216918:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000405:0x1a6:0x0](ffff9cfe0edc3248) 00000080:00200000:0.0:1767316904.216993:0:83725:0:(file.c:6809:ll_layout_conf()) [0x240000405:0x1a6:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1767316904.216999:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x1a6:0x0](ffff9cfe0edc3248) for lock 0xd9a0da65fad5722e 00000080:00010000:0.0:1767316904.217008:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x1a6:0x0](ffff9cfe0edc3248) 00000080:00010000:0.0:1767316904.217012:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5722e from it ffffa99f40d87df8 00010000:00010000:0.0:1767316904.217016:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae142 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.217024:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae142 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.217052:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x54:0x0](ffff9cfe0edc1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316904.217061:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f70a.sanity-flr.fsxlog, dir=[0x200000405:0x54:0x0](ffff9cfe0edc1148) 00010000:00010000:0.0:1767316904.217132:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.217217:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae142 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.217228:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x240000405:0x1a6:0x0]: losing layout lock 00010000:00010000:0.0:1767316904.217256:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 1/0,0 mode: --/PR res: [0x240000405:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae142 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.217272:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 1/0,0 mode: --/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.217278:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316904.217281:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad5722e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae142 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.217294:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad57219 lrc: 0/0,0 mode: --/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae103 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316904.217312:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316904.217318:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11323480 x1853163894123008/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316904.217339:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894123008:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316904.217514:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.222758:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323480 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894123008:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.222823:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x240000405:0x1a6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316904.222836:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316904.222862:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x240000405:0x1a6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.222869:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000405:0x1a6:0x0](ffff9cfe0edc3248) 00000080:00200000:0.0:1767316904.222959:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x54:0x0](ffff9cfe0edc1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.222977:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f70a.sanity-flr.fsxgood, dir=[0x200000405:0x54:0x0](ffff9cfe0edc1148), flags=0 00000080:00200000:0.0:1767316904.222981:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f70a.sanity-flr.fsxgood, dir=[0x200000405:0x54:0x0](ffff9cfe0edc1148), intent=getattr 00000002:00010000:0.0:1767316904.223002:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f70a.sanity-flr.fsxgood,[0x0:0x0:0x0]) in obj [0x240000406:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.223050:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.223069:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.223097:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.223117:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894123136:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.223296:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.227491:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894123136:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.227517:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 4/1,0 mode: --/CR res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae17a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.227547:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae17a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.227555:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae17a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.227575:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae17a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.227586:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae17a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.227597:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae17a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.227605:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae17a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.227632:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae17a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.227644:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322680 x1853163894123136/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/640 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.227655:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae17a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.227667:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae17a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.227677:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/421 (0 0) 00000080:00200000:0.0:1767316904.227684:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000406:0x6:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.227716:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000405:0x1a5:0x0](ffff9cfe0edc00c8) 00000080:00200000:0.0:1767316904.227796:0:83725:0:(file.c:6809:ll_layout_conf()) [0x240000405:0x1a5:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1767316904.227803:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x1a5:0x0](ffff9cfe0edc00c8) for lock 0xd9a0da65fad57235 00000080:00010000:0.0:1767316904.227821:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x1a5:0x0](ffff9cfe0edc00c8) 00000080:00010000:0.0:1767316904.227827:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57235 from it ffffa99f40d87df8 00010000:00010000:0.0:1767316904.227830:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae17a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.227840:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae17a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.227869:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x54:0x0](ffff9cfe0edc1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316904.227877:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f70a.sanity-flr.fsxgood, dir=[0x200000405:0x54:0x0](ffff9cfe0edc1148) 00010000:00010000:0.0:1767316904.227917:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae17a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.227936:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x240000405:0x1a5:0x0]: losing layout lock 00010000:00010000:0.0:1767316904.227968:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae17a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.227974:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316904.227977:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57235 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae17a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767316904.227995:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316904.228001:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11322680 x1853163894123392/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316904.228021:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894123392:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316904.228132:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.232819:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894123392:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.232880:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x240000405:0x1a5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316904.232905:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316904.232934:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x240000405:0x1a5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.232942:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000405:0x1a5:0x0](ffff9cfe0edc00c8) 00000080:00200008:0.0:1767316904.233020:0:83725:0:(file.c:424:ll_file_release()) START file d70a.sanity-flr:[0x200000405:0x54:0x0](ffff9cfe0edc1148), flags 704000 00010000:00010000:0.0:1767316904.233047:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57227 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae11f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.233119:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.233140:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.233149:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.233188:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.233196:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.233201:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.233205:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57204 00000080:00010000:0.0:1767316904.233212:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57204 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316904.233216:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.233223:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.233237:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.233248:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70a.sanity-flr, flags=0 00000080:00200000:0.0:1767316904.233254:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.233261:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.233267:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.233275:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.233282:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.233285:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.233288:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57204 00000080:00010000:0.0:1767316904.233291:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57204 from it ffffa99f40d87d88 00010000:00010000:0.0:1767316904.233294:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.233310:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.233318:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316904.233324:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d70a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316904.233344:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.233369:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57227 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae11f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.233415:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe11321c00 x1853163894122624/t8589937568(8589937568) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316920 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316904.233428:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316904.233432:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11321180 x1853163894123648/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316904.233454:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894123648:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316904.233535:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.237519:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894123648:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316904.237556:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe11321c00 x1853163894122624/t8589937568(8589937568) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767316904.237619:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.237664:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57227 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae11f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.237687:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 1/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.237693:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.237698:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1767316904.237701:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57227 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae11f expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.237713:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5720b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae0e7 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.237726:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57204 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae0cb expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316904.237745:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316904.237752:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11321180 x1853163894123904/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316904.237773:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894123904:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316904.237862:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1767316904.241915:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316904.242077:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939839616 00000100:00100000:2.0:1767316904.242129:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939839616 00000100:00100000:2.0:1767316904.242194:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10260 00000100:00100000:2.0:1767316904.242204:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939839616:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316904.242220:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.242291:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316904.242298:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15467:x1853163939839616:12345-192.168.202.121@tcp:104: Request processed in 96us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316904.242305:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10260 00010000:00010000:0.0:1767316904.242491:0:63840:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316904.242498:0:63840:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.242506:0:63840:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037d200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316904.242510:0:63840:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.242526:0:63840:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.242534:0:63840:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.242647:0:63840:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.242655:0:63840:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316904.242676:0:63840:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.242683:0:63840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad57212 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ae0f5 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.242701:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316904.242704:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316904.242705:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316904.243030:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894124032:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316904.247569:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894124032:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316904.259918:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894123904:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.259963:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x54:0x0](ffff9cfe0edc1148) 00000080:00200000:0.0:1767316904.260048:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.260069:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.260444:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.260454:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.260481:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.260501:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894124160:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.260590:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.263971:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894124160:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.263998:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.264011:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.264022:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.264031:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.264042:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.264049:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.264056:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.264068:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11320700 x1853163894124160/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.264132:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.264145:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316904.264152:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.264199:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.264205:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5723c 00000080:00010000:0.0:1767316904.264211:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.264213:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5723c from it ffffa99f40d87b58 00010000:00010000:0.0:1767316904.264216:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.264223:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.264249:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.264272:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d70.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316904.264276:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d70.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316904.264300:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.264346:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.264352:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.264362:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.264385:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894124288:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.264473:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.268929:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894124288:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.268957:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.268978:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.268986:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.268997:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.269007:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.269018:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.269025:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.269031:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.269042:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11320700 x1853163894124288/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/672 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.269055:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.269123:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/83 (0 0) 00000080:00200000:0.0:1767316904.269131:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.269171:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x53:0x0](ffff9cfe0edc1148) 00000002:00010000:0.0:1767316904.269199:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.269247:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.269254:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.269262:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.269283:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894124416:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.269368:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.272469:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894124416:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.272495:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.272506:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.272518:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.272528:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.272539:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.272576:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.272583:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.272594:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11321c00 x1853163894124416/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.272607:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.272620:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:0.0:1767316904.272627:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.272636:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.272664:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.272707:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.272715:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.272723:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.272744:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894124544:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.272832:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.275917:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894124544:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.275939:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 4/1,0 mode: --/CR res: [0x240000406:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.275949:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 4/1,0 mode: --/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.275959:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.275969:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.275980:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.275987:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 5/2,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.275994:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.276004:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11321c00 x1853163894124544/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.276016:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276029:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677446/5 (0 0) 00010000:00010000:0.0:1767316904.276053:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276062:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.276121:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x53:0x0], updating i_size 8192 00000080:00010000:0.0:1767316904.276132:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff9cfe0edc1148) for lock 0xd9a0da65fad57243 00000080:00010000:0.0:1767316904.276144:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff9cfe0edc1148) 00000080:00010000:0.0:1767316904.276147:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57243 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316904.276151:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276158:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316904.276202:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff9cfe0edc1148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.276210:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff9cfe0edc1148),name=d70.sanity-flr 00000002:00010000:0.0:1767316904.276234:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.276243:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276253:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.276260:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.276266:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276282:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276289:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276295:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.276304:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.276308:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276315:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276321:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276327:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.276334:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316904.276338:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff9cfe0edc1148) 00000080:00010000:0.0:1767316904.276341:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff9cfe0edc1148) for lock 0xd9a0da65fad57243 00000080:00010000:0.0:1767316904.276344:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57243 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316904.276346:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276363:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.276374:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.276380:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276386:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276393:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276399:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.276405:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.276409:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276415:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276422:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276428:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.276494:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.276502:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.276509:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276515:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.276521:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.276524:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.276526:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5723c 00000080:00010000:0.0:1767316904.276530:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5723c from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316904.276533:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.276540:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.276548:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.276555:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=266 00000080:00200000:0.0:1767316904.276572:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff9cfe0edc1148), inode mode 41ed mask 44 00000080:00200008:0.0:1767316904.276582:0:83725:0:(file.c:1001:ll_file_open()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff9cfe0edc1148), flags 704400 00000002:00010000:0.0:1767316904.276598:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767316904.276648:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57258 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.276654:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57258 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316904.276677:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316904.276685:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11320700 x1853163894124800/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/133424 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316904.276694:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57258 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.276716:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894124800:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.276906:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.284068:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894124800:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.284125:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57258 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.284137:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57258 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.284144:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57258 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.284152:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57258 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.284167:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57258 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.284173:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c200 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316904.284177:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57258 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.284189:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57258 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.284216:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57258 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.284223:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767316904.284228:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57258 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.284235:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad57258 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:0.0:1767316904.284251:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe11320700 x1853163894124800/t8589937571(8589937571) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316904.284265:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11320700 x1853163894124800/t8589937571(8589937571) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2216/696 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316904.284281:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.284307:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x53:0x0], updating i_size 4096 00000002:00100000:0.0:1767316904.284321:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11320700 x1853163894124800/t8589937571(8589937571) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316904.284384:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff9cfe0edc1148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.284391:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff9cfe0edc1148),name=d70.sanity-flr 00000002:00010000:0.0:1767316904.284408:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.284430:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.284442:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.284451:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.284462:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.284469:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.284477:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.284484:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.284498:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.284503:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.284510:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.284517:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.284524:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.284532:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316904.284536:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff9cfe0edc1148) 00000080:00010000:0.0:1767316904.284540:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff9cfe0edc1148) for lock 0xd9a0da65fad57243 00000080:00010000:0.0:1767316904.284544:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57243 from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316904.284547:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.284558:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.284581:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.284587:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.284594:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.284601:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.284608:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.284614:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.284618:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.284624:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.284631:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.284637:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.284676:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff9cfe0edc1148) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767316904.284688:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.284709:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316904.284715:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.284722:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316904.285505:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894124928:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316904.285607:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.298335:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894124928:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316904.299011:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.299027:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.299051:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316904.299067:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.299126:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316904.300425:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894125056:192.168.202.121@tcp:37:rm.0 00000100:00100000:0.0:1767316904.300537:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.308537:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894125056:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1767316904.309711:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.309732:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.309797:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff9cfe0edc1148) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200008:0.0:1767316904.309827:0:83725:0:(file.c:424:ll_file_release()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff9cfe0edc1148), flags 704000 00000002:00100000:0.0:1767316904.310001:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe11320700 x1853163894124800/t8589937571(8589937571) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316920 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316904.310013:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316904.310019:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11321c00 x1853163894125312/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2192 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316904.310044:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894125312:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316904.310306:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.314741:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894125312:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316904.314780:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe11320700 x1853163894124800/t8589937571(8589937571) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316904.314861:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.314882:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.315003:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.315016:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.315025:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.315030:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.315034:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5723c 00000080:00010000:0.0:1767316904.315040:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5723c from it ffffa99f40d87c10 00010000:00010000:0.0:1767316904.315044:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.315053:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.315069:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.315314:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=0 00000080:00200000:1.0:1767316904.315376:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.315389:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.315396:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.315404:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.315410:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.315416:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.315419:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5723c 00000080:00010000:1.0:1767316904.315423:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5723c from it ffffa99f40d87d88 00010000:00010000:1.0:1767316904.315425:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.315432:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.315440:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316904.315447:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d70.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316904.315467:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.315492:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.315531:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.315546:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.315552:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316904.315555:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d000/0xd9a0da65fad57243 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae1ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.316738:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d200/0xd9a0da65fad5723c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae1ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316904.316766:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316904.316781:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0558f100 x1853163894125568/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316904.316824:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894125568:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316904.317377:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acd80 going to sleep for 11 seconds 00000100:00100000:2.0:1767316904.321448:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316904.321540:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939840640 00000100:00100000:3.0:1767316904.321551:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939840640 00000100:00100000:3.0:1767316904.321617:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10261 00000100:00100000:3.0:1767316904.321627:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939840640:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316904.321646:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316904.321872:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316904.321880:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939840640:12345-192.168.202.121@tcp:104: Request processed in 254us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316904.321887:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10261 00010000:00010000:0.0:1767316904.322845:0:42048:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316904.322857:0:42048:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.322868:0:42048:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037ca00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316904.322874:0:42048:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.322883:0:42048:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.322902:0:42048:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.323058:0:42048:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.323065:0:42048:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316904.323125:0:42048:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.323133:0:42048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5724a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ae1f8 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.323151:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316904.323153:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316904.323155:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316904.323179:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316904.323205:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894125696:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316904.328028:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894125696:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316904.331441:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316904.331535:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939840896 00000100:00100000:3.0:1767316904.331546:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939840896 00000100:00100000:3.0:1767316904.331611:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10262 00000100:00100000:3.0:1767316904.331620:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939840896:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316904.331655:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316904.331745:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316904.331752:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:15472:x1853163939840896:12345-192.168.202.121@tcp:104: Request processed in 134us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316904.331760:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10262 00010000:00010000:0.0:1767316904.332245:0:49629:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316904.332254:0:49629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.332263:0:49629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c600 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316904.332268:0:49629:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.332276:0:49629:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.332299:0:49629:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.332404:0:49629:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 2/0,0 mode: --/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.332411:0:49629:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316904.332442:0:49629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 1/0,0 mode: --/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.332449:0:49629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57251 lrc: 0/0,0 mode: --/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ae206 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.332470:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316904.332472:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316904.332474:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316904.332499:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316904.332519:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894125824:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316904.340297:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894125824:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316904.352156:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0558f100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894125568:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316904.352212:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x53:0x0](ffff9cfe0edc1148) 00000080:00200000:1.0:1767316904.352302:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.352323:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.352383:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.352392:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.352400:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.352441:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894125952:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.352535:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acd80 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.357198:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894125952:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.357224:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.357236:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.357247:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.357257:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.357269:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.357277:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.357285:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.357296:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d1f80 x1853163894125952/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.357310:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.357340:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316904.357348:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316904.357376:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316904.357383:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5725f 00000080:00010000:1.0:1767316904.357390:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.357393:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5725f from it ffffa99f40d87b58 00010000:00010000:1.0:1767316904.357396:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.357404:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.357434:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.357459:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d71.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316904.357463:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d71.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316904.357487:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d71.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.357527:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.357534:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.357543:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.357573:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894126080:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.357660:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acd80 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.362121:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894126080:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.362383:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae268 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.362408:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae268 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.362415:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae268 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.362429:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae268 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.362440:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae268 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.362451:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae268 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.362459:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae268 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.362467:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae268 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.362479:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d1f80 x1853163894126080/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.362493:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae268 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.362502:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 9663677445/484 (0 0) 00000002:00010000:1.0:1767316904.362527:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000405:0x1e4:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.362585:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.362593:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.362602:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.362624:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894126208:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.362756:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acd80 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.367143:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894126208:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.367301:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 4/1,0 mode: --/CR res: [0x240000405:0x1e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.367314:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.367325:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.367334:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.367345:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.367353:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 5/2,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.367375:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.367387:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d3800 x1853163894126208/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/672 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.367401:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.367415:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677445/484 (0 0) 00000080:00200000:1.0:1767316904.367439:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316904.367479:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) 00000002:00010000:1.0:1767316904.367504:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.367551:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.367632:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.367645:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.367667:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894126336:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.367757:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acd80 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.371148:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894126336:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.371256:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 4/1,0 mode: --/CR res: [0x240000403:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.371271:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.371297:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.371307:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.371320:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 5/2,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.371328:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 5/2,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.371335:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.371346:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d1f80 x1853163894126336/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.371358:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.371371:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 4 res 9663677443/3 (0 0) 00010000:00010000:1.0:1767316904.371378:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.371386:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.371418:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.371474:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.371482:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.371490:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.371513:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894126464:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.371723:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acd80 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.377482:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894126464:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.377506:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.377518:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.377530:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.377541:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.377552:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.377636:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.377645:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.377673:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d1f80 x1853163894126464/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/640 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.377688:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.377703:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935617/6 (0 0) 00010000:00010000:1.0:1767316904.377711:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.377720:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.377761:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x1e4:0x0], updating i_size 8192 00000080:00010000:1.0:1767316904.377773:0:83725:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) for remote lock 0xd9a0da65fad5726d 00000080:00010000:1.0:1767316904.377778:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) for lock 0xd9a0da65fad57266 00000080:00010000:1.0:1767316904.377791:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) 00000080:00010000:1.0:1767316904.377795:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57266 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316904.377798:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae268 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.377805:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae268 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1767316904.377823:0:83725:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xd9a0da65fad5726d from it ffffa99f40d87b20 00010000:00010000:1.0:1767316904.377827:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.377843:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316904.377881:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d71.sanity-flr:[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.377889:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248),name=d71.sanity-flr 00000002:00010000:1.0:1767316904.378020:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1e4:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.378029:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378041:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.378050:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.378056:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378062:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378068:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378074:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.378329:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.378337:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378358:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378366:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378373:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.378382:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316904.378388:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) 00000080:00010000:1.0:1767316904.378391:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) for lock 0xd9a0da65fad5726d 00000080:00010000:1.0:1767316904.378395:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5726d from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316904.378398:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378405:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.378417:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.378423:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378430:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378436:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378454:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.378463:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.378468:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378475:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378482:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378488:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.378544:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.378554:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.378641:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378650:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.378656:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.378661:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.378663:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5725f 00000080:00010000:1.0:1767316904.378667:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5725f from it ffffa99f40d87bf8 00010000:00010000:1.0:1767316904.378676:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.378683:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.378691:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.378698:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71.sanity-flr, flags=266 00000080:00200000:1.0:1767316904.378704:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248), inode mode 41ed mask 44 00000080:00200008:1.0:1767316904.378711:0:83725:0:(file.c:1001:ll_file_open()) START file d71.sanity-flr:[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248), flags 704400 00000002:00010000:1.0:1767316904.378728:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1e4:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1767316904.378794:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57282 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.378802:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57282 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:1.0:1767316904.378823:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767316904.378833:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0f3d3800 x1853163894126720/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767316904.378844:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57282 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.378869:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894126720:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.379377:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acd80 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.383492:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894126720:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.383520:0:83725:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57282 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.383533:0:83725:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57282 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.383555:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57282 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.383637:0:83725:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57282 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.383645:0:83725:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57282 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.383652:0:83725:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2c800 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316904.383656:0:83725:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57282 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.383663:0:83725:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57282 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.383669:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57282 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.383676:0:83725:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767316904.383683:0:83725:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57282 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.383688:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57282 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 83725 initiator: MDT0 00000002:00100000:1.0:1767316904.383717:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9cfe0f3d3800 x1853163894126720/t4294975995(4294975995) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/696 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767316904.383729:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0f3d3800 x1853163894126720/t4294975995(4294975995) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/696 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316904.383746:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316904.383782:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x1e4:0x0], updating i_size 4096 00000002:00100000:1.0:1767316904.383803:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe0f3d3800 x1853163894126720/t4294975995(4294975995) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1767316904.383881:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d71.sanity-flr:[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.383889:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248),name=d71.sanity-flr 00000002:00010000:1.0:1767316904.384006:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1e4:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.384021:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.384035:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.384044:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.384049:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.384055:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.384062:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.384069:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.384550:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.384571:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.384599:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.384607:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.384615:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.384627:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1767316904.384634:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) 00000080:00010000:1.0:1767316904.384638:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) for lock 0xd9a0da65fad5726d 00000080:00010000:1.0:1767316904.384642:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5726d from it ffffa99f40d87cd8 00010000:00010000:1.0:1767316904.384646:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.384652:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.384664:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.384670:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.384678:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.384685:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.384702:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.384711:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.384716:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.384724:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.384731:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.384738:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.384769:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) pos/size0/8192 32bit_api 0 00010000:00010000:1.0:1767316904.384781:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.384806:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316904.384823:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.384831:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316904.385963:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894126848:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316904.386330:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acd80 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.394422:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894126848:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316904.395124:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.395139:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.395180:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767316904.395195:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.395208:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316904.395782:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894126976:192.168.202.121@tcp:37:rm.0 00000100:00100000:1.0:1767316904.395916:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acd80 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.404154:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894126976:192.168.202.121@tcp:37:rm.0 00010000:00010000:1.0:1767316904.404830:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.404844:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767316904.404926:0:83725:0:(file.c:424:ll_file_release()) START file d71.sanity-flr:[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248), flags 704000 00000002:00100000:1.0:1767316904.404993:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe0f3d3800 x1853163894126720/t4294975995(4294975995) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316920 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316904.405025:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316904.405031:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0f3d1f80 x1853163894127232/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316904.405052:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894127232:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316904.409757:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086acd80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.414215:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894127232:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316904.414260:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe0f3d3800 x1853163894126720/t4294975995(4294975995) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316904.414343:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.414362:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.414380:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.414407:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.414415:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.414421:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.414425:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5725f 00000080:00010000:0.0:1767316904.414454:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5725f from it ffffa99f40d87bf8 00010000:00010000:0.0:1767316904.414459:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.414468:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.414484:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.414492:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71.sanity-flr, flags=266 00000080:00200000:0.0:1767316904.414499:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248), inode mode 41ed mask 44 00000080:00200008:0.0:1767316904.414508:0:83725:0:(file.c:1001:ll_file_open()) START file d71.sanity-flr:[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248), flags 704400 00000002:00010000:0.0:1767316904.414526:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1e4:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1767316904.414599:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57289 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.414606:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57289 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000020:00100000:0.0:1767316904.414618:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767316904.414624:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11321c00 x1853163894127488/t0(0) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/133552 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767316904.414633:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57289 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.414662:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894127488:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.414855:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.419222:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894127488:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.419272:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57289 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x1e4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae2ae expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419282:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57289 lrc: 4/1,0 mode: --/CR res: [0x240000405:0x1e4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae2ae expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419293:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57289 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1e4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae2ae expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419303:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57289 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1e4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae2ae expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.419319:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9cfe11321c00 x1853163894127488/t4294975997(4294975997) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/696 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316904.419331:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11321c00 x1853163894127488/t4294975997(4294975997) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 2344/696 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.419345:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57289 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1e4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae2ae expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419355:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10359000 type 13 mode 16 res 9663677445/484 (0 0) 00000080:00200000:0.0:1767316904.419361:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.419394:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000405:0x1e4:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.419402:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) for lock 0xd9a0da65fad57289 00000080:00010000:0.0:1767316904.419429:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57289 from it ffffa99f40d87bd0 00010000:00010000:0.0:1767316904.419433:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57289 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1e4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae2ae expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419442:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57289 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x1e4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae2ae expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.419467:0:83725:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9cfe11321c00 x1853163894127488/t4294975997(4294975997) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316920 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316904.419534:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file d71.sanity-flr:[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.419542:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248),name=d71.sanity-flr 00000002:00010000:0.0:1767316904.419573:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000405:0x1e4:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.419584:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419595:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 2/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.419605:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.419611:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419618:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419626:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419633:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.419649:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.419656:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419664:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419671:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419678:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.419687:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1767316904.419692:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) 00000080:00010000:0.0:1767316904.419696:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) for lock 0xd9a0da65fad5726d 00000080:00010000:0.0:1767316904.419700:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5726d from it ffffa99f40d87cd8 00010000:00010000:0.0:1767316904.419703:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419709:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.419720:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.419726:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419733:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419748:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419755:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.419763:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.419768:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419775:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419783:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419790:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.419835:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) pos/size0/8192 32bit_api 0 00010000:00010000:0.0:1767316904.419850:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.419873:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000403:0x3:0x0]) in obj [0x240000403:0x3:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316904.419880:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419886:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767316904.419906:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767316904.419910:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419917:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.419928:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x6:0x0]) in obj [0x200000401:0x6:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316904.419934:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419942:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00200000:0.0:1767316904.419954:0:83725:0:(mdc_request.c:1173:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:0.0:1767316904.419957:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.419964:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.419999:0:83725:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) pos/size18446744073709551614/8192 32bit_api 0 00000080:00200000:0.0:1767316904.420027:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.420044:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f71.sanity-flr, dir=[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248), flags=0 00000080:00200000:0.0:1767316904.420049:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f71.sanity-flr, dir=[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248), intent=getattr 00000002:00010000:0.0:1767316904.420063:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f71.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000401:0x6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.420155:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.420168:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.420190:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.420216:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894127616:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.420312:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.425153:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894127616:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.425181:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae2d1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.425205:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae2d1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.425212:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae2d1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.425224:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae2d1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.425234:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae2d1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.425245:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae2d1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.425252:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae2d1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.425278:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae2d1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.425290:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11320700 x1853163894127616/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/824 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.425302:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae2d1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.425314:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae2d1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.425324:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/85 (0 0) 00000080:00200000:0.0:1767316904.425330:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000401:0x6:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.425361:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x55:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316904.425423:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x55:0x0], updating i_size 0 00000080:00200000:0.0:1767316904.425442:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x55:0x0]: layout version change: 4294967294 -> 1 00000080:00010000:0.0:1767316904.425448:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x55:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad57290 00000080:00010000:0.0:1767316904.425457:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x55:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.425460:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57290 from it ffffa99f40d87df8 00010000:00010000:0.0:1767316904.425464:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae2d1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.425473:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae2d1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.425500:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248), inode mode 41ed mask 3 00000080:00200000:0.0:1767316904.425507:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f71.sanity-flr, dir=[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) 00010000:00010000:0.0:1767316904.425556:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.425617:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae2d1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.425627:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x55:0x0]: losing layout lock 00010000:00010000:0.0:1767316904.425656:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae2d1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.425663:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 1/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.425669:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316904.425672:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad57290 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae2d1 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.425686:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2da00/0xd9a0da65fad5727b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae292 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316904.425701:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316904.425707:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11320700 x1853163894127872/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316904.425727:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894127872:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316904.425805:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.431154:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894127872:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.431235:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x55:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316904.431249:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x55:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316904.431253:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316904.431278:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:0.0:1767316904.431314:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x55:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.431323:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x55:0x0](ffff9cfe0edc21c8) 00000080:00200008:0.0:1767316904.431420:0:83725:0:(file.c:424:ll_file_release()) START file d71.sanity-flr:[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248), flags 704000 00010000:00010000:0.0:1767316904.431451:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57289 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x1e4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae2ae expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.431492:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.431511:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.431522:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.431531:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.431538:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.431544:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.431547:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5725f 00000080:00010000:0.0:1767316904.431555:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5725f from it ffffa99f40d87c10 00010000:00010000:0.0:1767316904.431737:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.431749:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.431763:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.431774:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d71.sanity-flr, flags=0 00000080:00200000:0.0:1767316904.431781:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.431790:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.431796:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.431822:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.431834:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.431839:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.431844:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5725f 00000080:00010000:0.0:1767316904.431847:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5725f from it ffffa99f40d87d88 00010000:00010000:0.0:1767316904.431850:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.431857:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.431866:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316904.431873:0:83725:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d71.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316904.431899:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae268 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.431954:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae268 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.431961:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316904.431986:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c400/0xd9a0da65fad57266 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae268 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.432009:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57289 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x1e4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae2ae expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.432048:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe11321c00 x1853163894127488/t4294975997(4294975997) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316920 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316904.432066:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316904.432072:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11320380 x1853163894128256/t0(0) o35->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2320 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316904.432297:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894128000:192.168.202.121@tcp:103:rm.0 00000100:00100000:0.0:1767316904.433527:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894128256:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316904.433607:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.436317:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894128000:192.168.202.121@tcp:103:rm.0 00000100:00100000:0.0:1767316904.440651:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894128256:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316904.440692:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe11321c00 x1853163894127488/t4294975997(4294975997) o101->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 608/696 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1767316904.440745:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.440796:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57289 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1e4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae2ae expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.440804:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 1/0,0 mode: --/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.440820:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316904.440823:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57289 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1e4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae2ae expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.440835:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c000/0xd9a0da65fad5726d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1e4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae276 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316904.440861:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316904.440868:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11320380 x1853163894128512/t0(0) o36->lustre-MDT0001-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316904.440920:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894128512:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316904.441003:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1767316904.444230:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316904.444318:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939842048 00000100:00100000:2.0:1767316904.444330:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939842048 00000100:00100000:2.0:1767316904.444386:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10263 00000100:00100000:2.0:1767316904.444396:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939842048:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316904.444413:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.444491:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316904.444498:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:9a586faf-b087-472d-9665-d3bc7d15b908+5:15473:x1853163939842048:12345-192.168.202.121@tcp:104: Request processed in 103us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316904.444505:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10263 00010000:00010000:1.0:1767316904.444584:0:63296:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316904.444592:0:63296:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.444600:0:63296:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2cc00 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:1.0:1767316904.444605:0:63296:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.444614:0:63296:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.444623:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.444685:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.444691:0:63296:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316904.444716:0:63296:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.444739:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5725f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ae24c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.444758:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316904.444760:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316904.444762:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316904.444770:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316904.444787:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894128640:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316904.447971:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894128640:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316904.453185:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316904.453506:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939842816 00000100:00100000:2.0:1767316904.453517:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939842816 00000100:00100000:2.0:1767316904.453643:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10264 00000100:00100000:2.0:1767316904.453654:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe18fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939842816:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316904.453672:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.453795:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316904.453802:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe18fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:9a586faf-b087-472d-9665-d3bc7d15b908+5:19230:x1853163939842816:12345-192.168.202.121@tcp:104: Request processed in 151us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316904.453820:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10264 00010000:00010000:0.0:1767316904.455359:0:63142:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316904.455372:0:63142:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.455384:0:63142:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe03c2d000 already unused, calling callback (ffffffffc1bfeb40) 00010000:00010000:0.0:1767316904.455389:0:63142:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.455397:0:63142:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.455406:0:63142:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.455523:0:63142:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.455530:0:63142:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767316904.455683:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894128768:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767316904.455850:0:63142:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 1/0,0 mode: --/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.455859:0:63142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d000/0xd9a0da65fad57274 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x3:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x863eb2f6655ae284 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.455878:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316904.455880:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316904.455907:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316904.460425:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894128768:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316904.491716:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894128512:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.491760:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000405:0x1e4:0x0](ffff9cfe0ed9b248) 00000080:00200000:0.0:1767316904.491854:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.491881:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.491935:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.491943:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.491950:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.491965:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894128896:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.492042:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.498890:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894128896:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.498920:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.498933:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.498945:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.498956:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.498968:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.498989:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.498996:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.499007:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322a00 x1853163894128896/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.499020:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.499033:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316904.499050:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.499113:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.499120:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57297 00000080:00010000:0.0:1767316904.499126:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.499128:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57297 from it ffffa99f40d87b58 00010000:00010000:0.0:1767316904.499131:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.499140:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.499175:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.499204:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0g.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316904.499209:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0g.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316904.499232:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0g.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.499284:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.499291:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.499301:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.499323:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894129024:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.499480:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.508742:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894129024:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.508768:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.508793:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.508801:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.508821:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.508832:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.508842:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.508849:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.508874:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.508887:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322a00 x1853163894129024/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/928 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.508909:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.508923:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.508933:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/27 (0 0) 00000080:00200000:0.0:1767316904.508939:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.508975:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x1b:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316904.509042:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x1b:0x0], updating i_size 158 00000080:00200000:0.0:1767316904.509066:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x1b:0x0]: layout version change: 4294967294 -> 6 00000080:00010000:0.0:1767316904.509072:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1b:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad5729e 00000080:00010000:0.0:1767316904.509114:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1b:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.509117:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5729e from it ffffa99f40d87b20 00010000:00010000:0.0:1767316904.509121:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.509129:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316904.509178:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f0g.sanity-flr:[0x200000402:0x1b:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.509394:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x1b:0x0](ffff9cfe0edc21c8),name=f0g.sanity-flr 00000002:00010000:0.0:1767316904.509422:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1b:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.509429:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.509439:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.509445:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.509449:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1b:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.509452:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1b:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad5729e 00000080:00010000:0.0:1767316904.509456:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5729e from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316904.509458:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.509464:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.509507:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.509515:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.509523:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.509540:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.509547:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.509551:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.509553:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57297 00000080:00010000:0.0:1767316904.509557:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57297 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316904.509638:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.509645:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.509654:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.509663:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f0g.sanity-flr, flags=0 00000080:00200000:0.0:1767316904.509667:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.509675:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.509681:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.509688:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.509694:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.509698:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.509700:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57297 00000080:00010000:0.0:1767316904.509703:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57297 from it ffffa99f40d87d68 00010000:00010000:0.0:1767316904.509706:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.509712:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.509720:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316904.509725:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0g.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316904.509746:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.509782:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.509792:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x1b:0x0]: losing layout lock 00010000:00010000:0.0:1767316904.509834:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.509841:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.509846:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316904.509849:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5729e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae35d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.509866:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57297 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae341 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316904.509884:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316904.509967:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11322a00 x1853163894129280/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316904.509989:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894129280:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316904.510135:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.515789:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894129280:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.515865:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x1b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316904.515878:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x1b:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316904.515882:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316904.515987:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x16 00020000:00200000:0.0:1767316904.515999:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x6 00000080:00200000:0.0:1767316904.516020:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x1b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.516028:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x1b:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316904.516676:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.516704:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.516766:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.516775:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.516786:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.516819:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894129408:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.517004:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.520361:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894129408:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.520387:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.520399:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.520483:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.520496:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.520509:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.520587:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.520595:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.520608:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11321880 x1853163894129408/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.520620:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.520697:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316904.520704:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.520727:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.520733:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad572a5 00000080:00010000:0.0:1767316904.520738:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.520742:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572a5 from it ffffa99f40d87b58 00010000:00010000:0.0:1767316904.520745:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.520753:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.520776:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.520854:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f0j.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316904.520859:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f0j.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316904.520881:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0j.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.520929:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.520936:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.520946:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.520967:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894129536:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.521226:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.524533:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894129536:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.524575:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.524599:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.524607:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.524620:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.524642:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.524654:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.524662:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.524686:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.524698:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11321880 x1853163894129536/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/824 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.524710:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.524723:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.524733:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/29 (0 0) 00000080:00200000:0.0:1767316904.524740:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.524775:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x1d:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316904.524851:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x1d:0x0], updating i_size 1516 00000080:00200000:0.0:1767316904.524875:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x1d:0x0]: layout version change: 4294967294 -> 10 00000080:00010000:0.0:1767316904.524880:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1d:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad572ac 00000080:00010000:0.0:1767316904.524904:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1d:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.524908:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572ac from it ffffa99f40d87b20 00010000:00010000:0.0:1767316904.524912:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.524920:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316904.524958:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f0j.sanity-flr:[0x200000402:0x1d:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.524966:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x1d:0x0](ffff9cfe0edc21c8),name=f0j.sanity-flr 00000002:00010000:0.0:1767316904.524995:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1d:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.525002:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.525013:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.525020:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.525026:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1d:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.525030:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1d:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad572ac 00000080:00010000:0.0:1767316904.525034:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572ac from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316904.525037:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.525043:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.525143:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.525152:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.525893:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.525906:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.525914:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.525921:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.525923:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad572a5 00000080:00010000:0.0:1767316904.525928:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572a5 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316904.525941:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.525948:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.525959:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.525970:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f0j.sanity-flr, flags=0 00000080:00200000:0.0:1767316904.525976:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.525986:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.525992:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.526000:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.526007:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.526010:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.526013:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad572a5 00000080:00010000:0.0:1767316904.526016:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572a5 from it ffffa99f40d87d68 00010000:00010000:0.0:1767316904.526019:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.526026:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.526034:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316904.526039:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f0j.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316904.526066:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.526136:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.526146:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x1d:0x0]: losing layout lock 00010000:00010000:0.0:1767316904.526203:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.526211:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.526216:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316904.526219:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae3a3 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.526237:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae387 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316904.526254:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316904.526264:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11321880 x1853163894129792/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2192 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316904.526289:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894129792:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316904.526386:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.534900:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321880 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894129792:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.534969:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x1d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316904.534981:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x1d:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316904.534985:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316904.535006:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:0.0:1767316904.535034:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x1d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.535041:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x1d:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316904.535200:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.535222:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.535281:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.535291:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.535300:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.535321:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894129920:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.535403:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.539230:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894129920:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.539262:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.539274:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.539288:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.539299:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.539311:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.539337:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.539343:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.539355:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322300 x1853163894129920/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.539368:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.539381:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316904.539389:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.539418:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.539425:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad572b3 00000080:00010000:0.0:1767316904.539431:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.539434:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572b3 from it ffffa99f40d87b58 00010000:00010000:0.0:1767316904.539437:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.539445:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.539470:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.539492:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f1.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316904.539496:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f1.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316904.539520:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f1.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.539596:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.539603:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.539614:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.539642:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894130048:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.539742:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.545583:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894130048:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.545612:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.545634:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.545642:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.545652:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.545663:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.545675:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.545682:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.545705:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.545716:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322300 x1853163894130048/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/2304 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.545728:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 1720 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.545743:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.545754:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/30 (0 0) 00000080:00200000:0.0:1767316904.545763:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.545909:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x1e:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316904.546126:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x1e:0x0]: layout version change: 4294967294 -> 16 00000080:00010000:0.0:1767316904.546132:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1e:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad572ba 00000080:00010000:0.0:1767316904.546143:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1e:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.546146:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572ba from it ffffa99f40d87b20 00010000:00010000:0.0:1767316904.546148:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.546154:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316904.546200:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f1.sanity-flr:[0x200000402:0x1e:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.546206:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x1e:0x0](ffff9cfe0edc21c8),name=f1.sanity-flr 00000002:00010000:0.0:1767316904.546226:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.546236:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.546244:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.546248:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.546251:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1e:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.546253:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1e:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad572ba 00000080:00010000:0.0:1767316904.546256:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572ba from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316904.546258:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.546262:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.546274:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x1e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767316904.546282:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x1e:0x0]: flr state: 1, move mirror from 5 to 5, have retried: 0, mirror count: 16 00020000:00200000:0.0:1767316904.546284:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316904.546287:0:83725:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x1e:0x0] 00000008:00010000:0.0:1767316904.546300:0:83725:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316904.546302:0:83725:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc96b0, osc lock ffff9cfe201db690, flags 0x400000400001002 00010000:00010000:0.0:1767316904.546335:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.546340:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.546347:0:83725:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe11322300 x1853163894130176/t0(0) o101->lustre-OST0001-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1767316904.546375:0:83725:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1767316904.546388:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894130176:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.552458:0:2503:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.552488:0:2503:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3f0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.552505:0:2503:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3f0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.552517:0:2503:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3f0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316904.552533:0:2503:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae3f0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316904.552546:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767316904.552724:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae3f0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.552734:0:2503:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae3f0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.552743:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae3f0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.552774:0:2503:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae3f0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316904.552797:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894130176:192.168.202.121@tcp:101:rm.0 00000080:00200000:2.0:1767316904.552888:0:83725:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000402:0x1e:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1767316904.552993:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d176c0 (ffff9cfe0e4c8b48/0) at cl_lock_release():245 00000020:00010000:2.0:1767316904.552997:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d176c0 (ffff9cfe0e4c8b48/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316904.553009:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc96b0 (ffff9cfe0e4c8248/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316904.553014:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d176c0 (ffff9cfe0e4c8b48/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316904.553017:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc96b0 (ffff9cfe0e4c8b48/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316904.553033:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x1e:0x0] ignore/verify layout 0/1, layout version 16 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316904.553303:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316904.553328:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.553343:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.553355:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.553362:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316904.553368:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316904.553372:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad572b3 00000080:00010000:2.0:1767316904.553377:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572b3 from it ffffa99f40d87c10 00010000:00010000:2.0:1767316904.553380:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.553386:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.553395:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316904.553406:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f1.sanity-flr, flags=0 00000080:00200000:2.0:1767316904.553412:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316904.553419:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.553425:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.553444:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.553450:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316904.553454:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316904.553457:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad572b3 00000080:00010000:2.0:1767316904.553462:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572b3 from it ffffa99f40d87d68 00010000:00010000:2.0:1767316904.553465:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.553471:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.553478:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:2.0:1767316904.553484:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f1.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:2.0:1767316904.553513:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.553538:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316904.553549:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x1e:0x0]: losing layout lock 00010000:00010000:2.0:1767316904.553597:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.553604:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.553609:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767316904.553617:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad572ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae3e9 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.553650:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad572b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae3cd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767316904.553669:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767316904.553679:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe2910ad80 x1853163894130432/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767316904.553702:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910ad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894130432:192.168.202.121@tcp:36:rm.0 00000100:00100000:2.0:1767316904.553797:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255000 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.557855:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910ad80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894130432:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.557919:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x1e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316904.557930:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x1e:0x0]: flr state: 1, move mirror from 5 to 5, have retried: 0, mirror count: 16 00020000:00200000:0.0:1767316904.557933:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316904.557939:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[5] flags 0x10 00000080:00200000:0.0:1767316904.557963:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x1e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.557970:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x1e:0x0](ffff9cfe0edc21c8) 00000008:00010000:0.0:1767316904.558026:0:83725:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 1767315177 1767315177 1767315177 by oinfo size 0 blocks 0 [cma]time 1767315177 1767315177 1767315177 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae3f0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316904.558226:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.558247:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.558297:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.558305:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.558314:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.558332:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894130560:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.558419:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.565406:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894130560:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.565426:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.565435:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.565443:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.565450:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.565459:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.565464:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.565469:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.565476:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322300 x1853163894130560/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.565485:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.565494:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316904.565512:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.565535:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.565541:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad572c8 00000080:00010000:0.0:1767316904.565546:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.565549:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572c8 from it ffffa99f40d87b58 00010000:00010000:0.0:1767316904.565553:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.565571:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.565594:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.565613:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f202.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316904.565618:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f202.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316904.565648:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f202.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.565689:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.565696:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.565704:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.565724:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894130688:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.565805:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.572177:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894130688:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.572213:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.572258:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 4/1,0 mode: --/PR res: [0x200000405:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.572266:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 4/1,0 mode: --/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.572277:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.572287:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.572300:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.572307:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.572314:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.572326:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11322300 x1853163894130688/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/848 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.572336:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 264 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.572349:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.572368:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/98 (0 0) 00000080:00200000:0.0:1767316904.572375:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.572410:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x62:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316904.572492:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x62:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1767316904.572499:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x62:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad572cf 00000080:00010000:0.0:1767316904.572508:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x62:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.572512:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572cf from it ffffa99f40d87b20 00010000:00010000:0.0:1767316904.572516:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.572523:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316904.572574:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f202.sanity-flr:[0x200000405:0x62:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.572581:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x62:0x0](ffff9cfe0edc21c8),name=f202.sanity-flr 00000002:00010000:0.0:1767316904.572605:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x62:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.572614:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.572633:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.572640:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.572646:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x62:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.572649:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x62:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad572cf 00000080:00010000:0.0:1767316904.572653:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572cf from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316904.572656:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.572668:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.572686:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x62:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1767316904.572697:0:83725:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x62:0x0] 00000008:00010000:0.0:1767316904.572713:0:83725:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316904.572716:0:83725:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe18ee4ab0, osc lock ffff9cfe201dba20, flags 0x400001002 00000008:00010000:0.0:1767316904.572721:0:83725:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316904.572723:0:83725:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe18ee4af0, osc lock ffff9cfe201dbb50, flags 0x400001002 00010000:00010000:0.0:1767316904.572767:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.572776:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316904.572838:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316904.572857:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894130816:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.572968:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.572976:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316904.573003:0:83725:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000100:00100000:1.0:1767316904.573275:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894130944:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.577917:0:2503:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.577944:0:2503:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae444 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.577959:0:2503:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae444 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.577971:0:2503:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae444 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316904.578005:0:2503:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 2097152, setting rss=2097152; kms=2097152, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae444 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316904.578015:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316904.578018:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae444 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.578024:0:2503:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae444 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.578029:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae444 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.578034:0:2503:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae444 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316904.578053:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894130944:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.578073:0:2503:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.578119:0:2503:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae43d expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.578127:0:2503:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae43d expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.578146:0:2503:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae43d expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316904.578155:0:2503:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 1048576, setting rss=1048576; kms=1048576, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae43d expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316904.578163:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767316904.578175:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae43d expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.578189:0:2503:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae43d expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.578196:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae43d expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.578202:0:2503:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae43d expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316904.578213:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894130816:192.168.202.121@tcp:101:rm.0 00000080:00200000:0.0:1767316904.578280:0:83725:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x62:0x0] updating i_size 2097152 i_blocks 4096 00000020:00010000:0.0:1767316904.578287:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b0248 (ffff9cfe0e436ea8/0) at cl_lock_release():245 00000020:00010000:0.0:1767316904.578290:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b0248 (ffff9cfe0e436ea8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316904.578296:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe18ee4ab0 (ffff9cfe0e4c8128/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316904.578308:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe18ee4af0 (ffff9cfe0e436e18/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316904.578311:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b0248 (ffff9cfe0e436ea8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316904.578313:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe18ee4ab0 (ffff9cfe0e436ea8/1) at cl_lock_fini():72 00000020:00010000:0.0:1767316904.578317:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe18ee4af0 (ffff9cfe0e436ea8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316904.578330:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x62:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.578382:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.578403:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.578496:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.578509:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.578518:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.578525:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.578581:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad572c8 00000080:00010000:0.0:1767316904.578589:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572c8 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316904.578592:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.578600:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.578609:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.578674:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f202.sanity-flr, flags=0 00000080:00200000:0.0:1767316904.578682:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.578691:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.578698:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.578714:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.578720:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.578724:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.578727:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad572c8 00000080:00010000:0.0:1767316904.578731:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572c8 from it ffffa99f40d87d68 00010000:00010000:0.0:1767316904.578733:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.578740:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.578748:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316904.578752:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f202.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316904.578779:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.578802:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.578826:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x62:0x0]: losing layout lock 00010000:00010000:0.0:1767316904.578862:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 1/0,0 mode: --/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.578868:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.578873:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316904.578881:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572cf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae436 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.578910:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae41a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316904.578927:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316904.578936:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11322300 x1853163894131200/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316904.578958:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894131200:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316904.579055:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.584233:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11322300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894131200:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.584296:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x62:0x0] ignore/verify layout 1/0, layout version 3 restore needed 0 00020000:00200000:0.0:1767316904.584311:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1767316904.584323:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:0.0:1767316904.584351:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x62:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.584360:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x62:0x0](ffff9cfe0edc21c8) 00000008:00010000:0.0:1767316904.584395:0:83725:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 1048576 blocks 2048 [cma]time: 1767316522 1767316522 0 by oinfo size 1048576 blocks 2048 [cma]time 1767316522 1767316522 0 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae43d expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316904.584748:0:83725:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 2097152 blocks 2048 [cma]time: 1767316523 1767316523 0 by oinfo size 2097152 blocks 2048 [cma]time 1767316523 1767316523 0 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 1/0,0 mode: PR/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae444 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316904.584829:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.584856:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.585504:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.585522:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.585529:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.585552:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894131328:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.585641:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.588521:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894131328:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.588569:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.588581:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.588593:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.588602:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.588614:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.588630:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.588638:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.588676:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11320a80 x1853163894131328/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.588690:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.588703:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316904.588710:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.588738:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.588744:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad572e4 00000080:00010000:0.0:1767316904.588749:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.588752:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572e4 from it ffffa99f40d87b58 00010000:00010000:0.0:1767316904.588755:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.588763:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.588788:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.588818:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f203.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316904.588823:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f203.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316904.588845:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f203.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.588893:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.588900:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.588910:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.588938:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894131456:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.589022:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.594839:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894131456:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.594864:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.594886:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 4/1,0 mode: --/PR res: [0x200000405:0x64:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.594894:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 4/1,0 mode: --/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.594905:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.594915:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.594926:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.594934:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.594942:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.594954:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11320a80 x1853163894131456/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/848 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.595173:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 264 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.595244:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.595255:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/100 (0 0) 00000080:00200000:0.0:1767316904.595261:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.595294:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x64:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316904.595358:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x64:0x0], updating i_size 0 00000080:00200000:0.0:1767316904.595380:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x64:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:0.0:1767316904.595386:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x64:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad572eb 00000080:00010000:0.0:1767316904.595396:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x64:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.595399:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572eb from it ffffa99f40d87b20 00010000:00010000:0.0:1767316904.595402:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.595410:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316904.595448:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f203.sanity-flr:[0x200000405:0x64:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.595455:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x64:0x0](ffff9cfe0edc21c8),name=f203.sanity-flr 00000002:00010000:0.0:1767316904.595477:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x64:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.595485:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.595495:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.595508:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.595513:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x64:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.595516:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x64:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad572eb 00000080:00010000:0.0:1767316904.595521:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572eb from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316904.595524:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.595991:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.596048:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.596059:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.596067:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.596075:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.596913:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.596921:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.596926:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad572e4 00000080:00010000:0.0:1767316904.596932:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572e4 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316904.596936:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.596943:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.596973:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.596986:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f203.sanity-flr, flags=0 00000080:00200000:0.0:1767316904.596992:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.597004:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.597012:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.597022:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.597028:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.597031:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.597034:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad572e4 00000080:00010000:0.0:1767316904.597037:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572e4 from it ffffa99f40d87d68 00010000:00010000:0.0:1767316904.597040:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.597048:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.597055:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316904.597060:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f203.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316904.597115:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.597141:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.597161:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x64:0x0]: losing layout lock 00010000:00010000:0.0:1767316904.597209:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 1/0,0 mode: --/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.597217:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.597223:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316904.597226:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad572eb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae48a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.597243:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae46e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316904.597260:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316904.597272:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11320a80 x1853163894131712/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316904.597296:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11320a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894131712:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316904.597393:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.601227:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11320a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894131712:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.601283:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x64:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316904.601292:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x64:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316904.601295:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316904.601300:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:0.0:1767316904.601329:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x64:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.601335:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x64:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316904.601447:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.601467:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.601517:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.601523:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.601530:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.601548:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894131840:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.601639:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.605359:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894131840:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.605385:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.605397:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.605408:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.605419:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.605430:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.605438:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.605463:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.605476:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11321c00 x1853163894131840/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.605490:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.605501:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316904.605508:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.605533:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.605540:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad572f2 00000080:00010000:0.0:1767316904.605545:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.605548:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572f2 from it ffffa99f40d87b58 00010000:00010000:0.0:1767316904.605551:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.605572:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.605597:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.605616:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f205a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316904.605621:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f205a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316904.605642:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f205a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.605681:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.605697:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.605706:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.605725:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894131968:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.605805:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.610163:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894131968:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.610202:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.610224:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x75:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.610232:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.610243:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.610254:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.610265:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.610272:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.610298:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.610310:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11321c00 x1853163894131968/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/928 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.610320:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.610332:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.610341:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/117 (0 0) 00000080:00200000:0.0:1767316904.610347:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.610380:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x75:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316904.610446:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x75:0x0], updating i_size 0 00000080:00200000:0.0:1767316904.610469:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x75:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:0.0:1767316904.610474:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x75:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad572f9 00000080:00010000:0.0:1767316904.610484:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x75:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.610488:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572f9 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316904.610491:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.610499:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316904.610535:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f205a.sanity-flr:[0x200000405:0x75:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.610542:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x75:0x0](ffff9cfe0edc21c8),name=f205a.sanity-flr 00000002:00010000:0.0:1767316904.610583:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x75:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.610591:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.610601:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.610606:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.610611:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x75:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.610614:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x75:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad572f9 00000080:00010000:0.0:1767316904.610618:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572f9 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316904.610620:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.610632:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.610677:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.610685:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.610691:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.610698:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.610703:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.610707:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.610709:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad572f2 00000080:00010000:0.0:1767316904.610712:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572f2 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316904.610721:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.610728:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.610736:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.610745:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f205a.sanity-flr, flags=0 00000080:00200000:0.0:1767316904.610750:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.610757:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.610763:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.610771:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.610777:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.610781:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.610784:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad572f2 00000080:00010000:0.0:1767316904.610787:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad572f2 from it ffffa99f40d87d68 00010000:00010000:0.0:1767316904.610790:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.610797:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.610816:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316904.610822:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f205a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316904.610842:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.610877:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.610886:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x75:0x0]: losing layout lock 00010000:00010000:1.0:1767316904.611775:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.611787:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.611805:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316904.611861:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad572f9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae4d0 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.611881:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad572f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae4b4 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316904.611990:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316904.612001:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0f3d0a80 x1853163894132224/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316904.612026:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894132224:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316904.612208:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.616237:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894132224:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316904.616303:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x75:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316904.616318:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x75:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316904.616322:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316904.616329:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x16 00000080:00200000:1.0:1767316904.616359:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x75:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.616366:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x75:0x0](ffff9cfe0edc21c8) 00000080:00200000:1.0:1767316904.616480:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.616501:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.616710:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.616721:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.616751:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.616773:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894132352:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.617031:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.621152:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894132352:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.621182:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.621194:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.621206:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.621216:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.621228:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.621234:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.621240:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.621251:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d2a00 x1853163894132352/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.621280:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.621293:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316904.621299:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316904.621331:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316904.621337:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57300 00000080:00010000:1.0:1767316904.621344:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.621347:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57300 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316904.621350:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.621358:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.621392:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.621416:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f205b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316904.621421:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f205b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316904.621443:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f205b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.621481:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.621488:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.621496:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.621516:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894132480:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.621728:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.624839:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894132480:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.624863:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.624884:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x78:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.624901:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.624913:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.624923:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.624934:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.624942:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.624950:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.624961:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d2a00 x1853163894132480/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/928 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.624972:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.624995:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.625006:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/120 (0 0) 00000080:00200000:1.0:1767316904.625013:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316904.625049:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x78:0x0](ffff9cfe0ed9a1c8) 00000080:00200000:1.0:1767316904.625152:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x78:0x0], updating i_size 0 00000080:00200000:1.0:1767316904.625175:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x78:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:1.0:1767316904.625182:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x78:0x0](ffff9cfe0ed9a1c8) for lock 0xd9a0da65fad57307 00000080:00010000:1.0:1767316904.625193:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x78:0x0](ffff9cfe0ed9a1c8) 00000080:00010000:1.0:1767316904.625197:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57307 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316904.625200:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.625207:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767316904.625248:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f205b.sanity-flr:[0x200000405:0x78:0x0](ffff9cfe0ed9a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.625255:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x78:0x0](ffff9cfe0ed9a1c8),name=f205b.sanity-flr 00000002:00010000:1.0:1767316904.625278:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x78:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.625286:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.625297:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.625303:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.625315:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x78:0x0](ffff9cfe0ed9a1c8) 00000080:00010000:1.0:1767316904.625319:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x78:0x0](ffff9cfe0ed9a1c8) for lock 0xd9a0da65fad57307 00000080:00010000:1.0:1767316904.625323:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57307 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316904.625326:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.625332:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.625382:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.625390:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.625397:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.625406:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.625412:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.625416:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.625418:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57300 00000080:00010000:1.0:1767316904.625422:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57300 from it ffffa99f40d87c10 00010000:00010000:1.0:1767316904.625424:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.625432:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.625440:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.625450:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f205b.sanity-flr, flags=0 00000080:00200000:1.0:1767316904.625459:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.625464:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.625470:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.625477:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.625483:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.625486:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.625489:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57300 00000080:00010000:1.0:1767316904.625491:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57300 from it ffffa99f40d87d68 00010000:00010000:1.0:1767316904.625494:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.625501:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.625508:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316904.625512:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f205b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316904.625536:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.625692:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.625704:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x78:0x0]: losing layout lock 00010000:00010000:1.0:1767316904.625741:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.625757:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.625762:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316904.625765:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad57307 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae516 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.625786:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57300 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae4fa expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316904.625814:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316904.625824:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0f3d2a00 x1853163894132736/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316904.625850:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894132736:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316904.625944:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.631689:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894132736:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316904.631752:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x78:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316904.631766:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x78:0x0]: flr state: 1, move mirror from 2 to 2, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316904.631769:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316904.631776:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x416 00000080:00200000:1.0:1767316904.631815:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x78:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.631823:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x78:0x0](ffff9cfe0ed9a1c8) 00000080:00200000:1.0:1767316904.631938:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.631967:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.632030:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.632059:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.632070:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.632130:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894132864:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.632421:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.635841:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894132864:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.635871:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.635882:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.635905:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.635917:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.635928:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.635937:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.635944:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.635976:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d1180 x1853163894132864/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.635991:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.636004:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316904.636011:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316904.636045:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316904.636052:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5730e 00000080:00010000:1.0:1767316904.636057:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.636061:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5730e from it ffffa99f40d87b58 00010000:00010000:1.0:1767316904.636064:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.636072:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.636124:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.636146:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f206.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316904.636150:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f206.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316904.636175:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f206.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.636220:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.636226:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.636235:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.636267:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894132992:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.636362:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.640580:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894132992:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.640608:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.640631:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.640639:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.640651:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.640661:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.640671:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.640678:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.640684:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.640694:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d1180 x1853163894132992/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/840 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.640721:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 256 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.640732:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.640742:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/123 (0 0) 00000080:00200000:1.0:1767316904.640748:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316904.640789:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x7b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316904.640799:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x7b:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316904.640802:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316904.640819:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316904.640847:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x7b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.641048:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x7b:0x0], updating i_size 0 00000080:00200000:1.0:1767316904.641053:0:83725:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x7b:0x0](ffff9cfe0eda0908): rc = 0 00000080:00200000:1.0:1767316904.641070:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x7b:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:1.0:1767316904.641076:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x7b:0x0](ffff9cfe0eda0908) for lock 0xd9a0da65fad57315 00000080:00010000:1.0:1767316904.641370:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x7b:0x0](ffff9cfe0eda0908) 00000080:00010000:1.0:1767316904.641374:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57315 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316904.641378:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.641388:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767316904.641440:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f206.sanity-flr:[0x200000405:0x7b:0x0](ffff9cfe0eda0908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.641448:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x7b:0x0](ffff9cfe0eda0908),name=f206.sanity-flr 00000002:00010000:1.0:1767316904.641482:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x7b:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.641493:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.641505:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.641511:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.641516:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x7b:0x0](ffff9cfe0eda0908) 00000080:00010000:1.0:1767316904.641519:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x7b:0x0](ffff9cfe0eda0908) for lock 0xd9a0da65fad57315 00000080:00010000:1.0:1767316904.641522:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57315 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316904.641525:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.641531:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.641590:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.641598:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.641605:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.641613:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.641618:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.641621:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.641623:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5730e 00000080:00010000:1.0:1767316904.641626:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5730e from it ffffa99f40d87c10 00010000:00010000:1.0:1767316904.641636:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.641643:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.641652:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.641660:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f206.sanity-flr, flags=0 00000080:00200000:1.0:1767316904.641665:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.641672:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.641677:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.641685:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.641691:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.641695:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.641698:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5730e 00000080:00010000:1.0:1767316904.641701:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5730e from it ffffa99f40d87d68 00010000:00010000:1.0:1767316904.641704:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.641710:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.641718:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316904.641723:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f206.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316904.641744:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.641778:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.641787:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x7b:0x0]: losing layout lock 00010000:00010000:1.0:1767316904.641829:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.641837:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.641842:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316904.641845:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57315 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae55c expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.641862:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5730e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae540 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316904.641880:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316904.641904:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0f3d1180 x1853163894133248/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316904.641928:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894133248:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316904.642034:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.646920:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894133248:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316904.647003:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x7b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316904.647018:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x7b:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316904.647022:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316904.647052:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x16 00000080:00200000:1.0:1767316904.647107:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x7b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.647116:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x7b:0x0](ffff9cfe0eda0908) 00000080:00200000:1.0:1767316904.647415:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.647439:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.647501:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.647511:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.647521:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.647544:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894133376:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.648380:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.652667:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894133376:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.652697:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.652709:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.652721:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.652731:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.652742:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.652766:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.652772:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.652784:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d2300 x1853163894133376/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.652798:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.652820:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316904.652827:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316904.652857:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316904.652863:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5731c 00000080:00010000:1.0:1767316904.652868:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.652872:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5731c from it ffffa99f40d87b58 00010000:00010000:1.0:1767316904.652874:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.652882:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.652925:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.652946:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f209a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316904.652950:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f209a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316904.652973:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f209a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.653030:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.653037:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.653046:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.653067:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894133504:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.653196:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.656958:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894133504:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.656985:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.657010:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.657018:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.657030:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.657040:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.657051:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.657057:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.657110:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.657123:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d2300 x1853163894133504/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 592/824 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.657135:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.657150:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.657160:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/129 (0 0) 00000080:00200000:1.0:1767316904.657167:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316904.657379:0:83725:0:(namei.c:151:ll_iget()) got inode: [0x200000405:0x81:0x0](ffff9cfe187daa08): rc = 0 00000080:00200000:1.0:1767316904.657396:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x81:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:1.0:1767316904.657402:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x81:0x0](ffff9cfe187daa08) for lock 0xd9a0da65fad57323 00000080:00010000:1.0:1767316904.657413:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x81:0x0](ffff9cfe187daa08) 00000080:00010000:1.0:1767316904.657417:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57323 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316904.657421:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.657429:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767316904.657472:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f209a.sanity-flr:[0x200000405:0x81:0x0](ffff9cfe187daa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.657480:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x81:0x0](ffff9cfe187daa08),name=f209a.sanity-flr 00000002:00010000:1.0:1767316904.657500:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x81:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.657515:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.657526:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.657533:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.657537:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x81:0x0](ffff9cfe187daa08) 00000080:00010000:1.0:1767316904.657540:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x81:0x0](ffff9cfe187daa08) for lock 0xd9a0da65fad57323 00000080:00010000:1.0:1767316904.657544:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57323 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316904.657547:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.657554:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.657583:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x81:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1767316904.657593:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x81:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316904.657596:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316904.657601:0:83725:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x81:0x0] 00000008:00010000:1.0:1767316904.657617:0:83725:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316904.657621:0:83725:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d792b0, osc lock ffff9cfe09c744c0, flags 0x400000400001002 00010000:00010000:1.0:1767316904.657666:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5732a lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.657674:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5732a lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.657685:0:83725:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe0f3d2300 x1853163894133632/t0(0) o101->lustre-OST0000-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316904.657768:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894133632:192.168.202.121@tcp:101:rm.0 00000020:00200000:1.0:1767316904.658112:0:83725:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767316904.662716:0:2502:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5732a lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.662740:0:2502:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5732a lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5a9 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.662754:0:2502:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5732a lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5a9 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.662766:0:2502:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5732a lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5a9 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316904.662779:0:2502:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 5, setting rss=5; kms=5, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5732a lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae5a9 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316904.662790:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767316904.662801:0:2502:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5732a lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae5a9 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.662820:0:2502:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5732a lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae5a9 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.662848:0:2502:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5732a lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae5a9 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.662856:0:2502:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5732a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae5a9 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316904.662874:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894133632:192.168.202.121@tcp:101:rm.0 00000080:00200000:2.0:1767316904.663024:0:83725:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x81:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1767316904.663030:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b0248 (ffff9cfe0e436ea8/0) at cl_lock_release():245 00000020:00010000:2.0:1767316904.663033:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b0248 (ffff9cfe0e436ea8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316904.663038:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d792b0 (ffff9cfe0e4c87e8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316904.663042:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b0248 (ffff9cfe0e436ea8/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316904.663045:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d792b0 (ffff9cfe0e436ea8/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316904.663059:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x81:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316904.663129:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316904.663155:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.663169:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.663320:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.663330:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316904.663339:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316904.663349:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5731c 00000080:00010000:2.0:1767316904.663357:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5731c from it ffffa99f40d87c10 00010000:00010000:2.0:1767316904.663360:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.663366:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.663378:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316904.663390:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f209a.sanity-flr, flags=0 00000080:00200000:2.0:1767316904.663395:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316904.663402:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.663408:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.663416:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.663422:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316904.663426:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316904.663428:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5731c 00000080:00010000:2.0:1767316904.663432:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5731c from it ffffa99f40d87d68 00010000:00010000:2.0:1767316904.663435:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.663441:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.663449:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:2.0:1767316904.663459:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f209a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:2.0:1767316904.663484:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.663506:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316904.663515:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x81:0x0]: losing layout lock 00010000:00010000:2.0:1767316904.663546:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.663553:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.663740:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767316904.663744:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ce00/0xd9a0da65fad57323 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae5a2 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.663761:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c800/0xd9a0da65fad5731c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae586 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767316904.663778:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767316904.663787:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe2910a680 x1853163894133888/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767316904.663818:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894133888:192.168.202.121@tcp:36:rm.0 00000100:00100000:2.0:1767316904.664015:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe202559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.668745:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894133888:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316904.668817:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x81:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316904.668829:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x81:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316904.668832:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316904.668839:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316904.668870:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x81:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.668877:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x81:0x0](ffff9cfe187daa08) 00000008:00010000:1.0:1767316904.668923:0:83725:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 5 blocks 8 [cma]time: 1767316814 1767316814 1767316807 by oinfo size 5 blocks 8 [cma]time 1767316814 1767316814 1767316807 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5732a lrc: 1/0,0 mode: PR/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae5a9 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316904.669054:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.669075:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.669165:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.669173:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.669195:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.669215:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894134016:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.669776:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.673631:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894134016:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.673656:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.673679:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.673690:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.673700:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.673712:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.673719:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.673726:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.673736:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d3100 x1853163894134016/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.673749:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.673760:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316904.673767:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316904.673796:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316904.673802:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57331 00000080:00010000:1.0:1767316904.673818:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.673827:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57331 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316904.673831:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.673840:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.673868:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.673879:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f209b.sanity-flr, flags=8 00000080:00200008:1.0:1767316904.673972:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f209b.sanity-flr:[0x200000405:0x84:0x0](ffff9cfe187d9988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.673979:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x84:0x0](ffff9cfe187d9988),name=f209b.sanity-flr 00000002:00010000:1.0:1767316904.674003:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x84:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.674014:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03718200/0xd9a0da65fad56784 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655aba0c expref: -99 pid: 79724 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.674024:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03718200/0xd9a0da65fad56784 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655aba0c expref: -99 pid: 79724 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.674031:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.674035:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x84:0x0](ffff9cfe187d9988) 00000080:00010000:1.0:1767316904.674038:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x84:0x0](ffff9cfe187d9988) for lock 0xd9a0da65fad56784 00000080:00010000:1.0:1767316904.674042:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56784 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316904.674046:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03718200/0xd9a0da65fad56784 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655aba0c expref: -99 pid: 79724 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.674052:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03718200/0xd9a0da65fad56784 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655aba0c expref: -99 pid: 79724 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.674076:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x84:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1767316904.674115:0:83725:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x84:0x0] 00000008:00010000:1.0:1767316904.674142:0:83725:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316904.674146:0:83725:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79530, osc lock ffff9cfe09c75b50, flags 0x400001002 00010000:00010000:1.0:1767316904.674164:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03718000/0xd9a0da65fad56792 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655aba2f expref: -99 pid: 79733 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.674174:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03718000/0xd9a0da65fad56792 lrc: 2/1,0 mode: PR/PR res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655aba2f expref: -99 pid: 79733 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316904.674354:0:83725:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316904.674358:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03718000/0xd9a0da65fad56792 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655aba2f expref: -99 pid: 79733 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.674367:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03718000/0xd9a0da65fad56792 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655aba2f expref: -99 pid: 79733 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316904.674379:0:83725:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316904.674392:0:83725:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x84:0x0] updating i_size 8192 i_blocks 16 00000020:00010000:1.0:1767316904.674396:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d15da8 (ffff9cfe0e4c8908/0) at cl_lock_release():245 00000020:00010000:1.0:1767316904.674399:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d15da8 (ffff9cfe0e4c8908/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316904.674403:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79530 (ffff9cfe0e4c8ea8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316904.674406:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d15da8 (ffff9cfe0e4c8908/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316904.674409:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79530 (ffff9cfe0e4c8908/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316904.674419:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x84:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.674453:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.674463:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.674470:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.674714:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.674721:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.674726:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.674729:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57331 00000080:00010000:1.0:1767316904.674733:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57331 from it ffffa99f40d87c10 00010000:00010000:1.0:1767316904.674736:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.674743:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.674753:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.674761:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f209b.sanity-flr, flags=0 00000080:00200000:1.0:1767316904.674766:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.674774:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.674780:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.674787:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.674793:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.674796:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.674799:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57331 00000080:00010000:1.0:1767316904.674802:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57331 from it ffffa99f40d87d68 00010000:00010000:1.0:1767316904.674815:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.674828:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.674837:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316904.674844:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f209b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316904.674870:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.674989:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03718200/0xd9a0da65fad56784 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655aba0c expref: -99 pid: 79724 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.675001:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x84:0x0]: losing layout lock 00010000:00010000:1.0:1767316904.675038:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03718200/0xd9a0da65fad56784 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655aba0c expref: -99 pid: 79724 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.675046:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.675051:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316904.675054:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03718200/0xd9a0da65fad56784 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655aba0c expref: -99 pid: 79724 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.675073:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad57331 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae5d3 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316904.675269:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316904.675281:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0f3d3100 x1853163894134272/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 504/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316904.675315:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894134272:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316904.675470:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.684851:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894134272:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316904.685000:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x84:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316904.685018:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316904.685046:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x84:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.685335:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x84:0x0](ffff9cfe187d9988) 00000008:00010000:1.0:1767316904.685373:0:83725:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 8192 blocks 16 [cma]time: 1767316839 1767316839 0 by oinfo size 8192 blocks 16 [cma]time 1767316839 1767316839 1767316840 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03718000/0xd9a0da65fad56792 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655aba2f expref: -99 pid: 79733 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316904.685458:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.685482:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.685543:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.685551:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.685639:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.685666:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894134400:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.685819:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.689255:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894134400:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.689281:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.689314:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.689324:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.689334:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.689347:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.689353:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.689360:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.689370:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d0380 x1853163894134400/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.689384:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.689396:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316904.689403:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316904.689445:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316904.689452:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57338 00000080:00010000:1.0:1767316904.689458:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.689466:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57338 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316904.689470:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.689479:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.689507:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.689518:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=8 00000080:00200008:1.0:1767316904.689530:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f211.sanity-flr:[0x200000405:0x8a:0x0](ffff9cfe0edb21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.689535:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8),name=f211.sanity-flr 00000002:00010000:1.0:1767316904.689625:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.689637:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.689648:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.689654:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.689659:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000080:00010000:1.0:1767316904.689662:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff9cfe0edb21c8) for lock 0xd9a0da65fad56a08 00000080:00010000:1.0:1767316904.689666:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56a08 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316904.689669:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.689676:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.689695:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1767316904.689757:0:83725:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x8a:0x0] 00000008:00010000:1.0:1767316904.689776:0:83725:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316904.689779:0:83725:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d79530, osc lock ffff9cfe09c75b50, flags 0x400001002 00010000:00010000:1.0:1767316904.689795:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.689815:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 2/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316904.689827:0:83725:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316904.689830:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 5/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.689837:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316904.689847:0:83725:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1767316904.689858:0:83725:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000405:0x8a:0x0] updating i_size 4096 i_blocks 8 00000020:00010000:1.0:1767316904.689862:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d15da8 (ffff9cfe0e4c8908/0) at cl_lock_release():245 00000020:00010000:1.0:1767316904.689864:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d15da8 (ffff9cfe0e4c8908/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316904.689867:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d79530 (ffff9cfe0e4c8ea8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316904.689871:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d15da8 (ffff9cfe0e4c8908/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316904.689873:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d79530 (ffff9cfe0e4c8908/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316904.689885:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.690008:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.690018:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.690025:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.690043:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.690050:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.690054:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.690057:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57338 00000080:00010000:1.0:1767316904.690061:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57338 from it ffffa99f40d87c10 00010000:00010000:1.0:1767316904.690064:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.690071:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.690239:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.690248:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f211.sanity-flr, flags=0 00000080:00200000:1.0:1767316904.690252:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.690260:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.690267:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.690275:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.690280:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.690284:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.690287:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57338 00000080:00010000:1.0:1767316904.690290:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57338 from it ffffa99f40d87d68 00010000:00010000:1.0:1767316904.690293:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.690306:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.690315:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316904.690321:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f211.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316904.690346:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.690369:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.690380:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:1.0:1767316904.690390:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad56a0f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac1d0 expref: -99 pid: 81826 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1767316904.690436:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3f480 x1853163894004480/t8589937368(8589937368) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 656/744 e 0 to 0 dl 1767316894 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767316904.690447:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767316904.690453:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0f3d0380 x1853163894134656/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2216 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316904.690477:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894134656:192.168.202.121@tcp:35:rm.0 00000100:00100000:1.0:1767316904.690668:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.693536:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894134656:192.168.202.121@tcp:35:rm.0 00000002:00100000:1.0:1767316904.693639:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3f480 x1853163894004480/t8589937368(8589937368) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 656/744 e 0 to 0 dl 1767316894 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767316904.693698:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:1.0:1767316904.693721:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.693733:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:1.0:1767316904.693769:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.693775:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad56a0f lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac1d0 expref: -99 pid: 81826 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.693781:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.693787:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.693793:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 4 locks packed 00010000:00010000:1.0:1767316904.693796:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad56a08 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac1c2 expref: -99 pid: 81825 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.693819:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad56a0f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac1d0 expref: -99 pid: 81826 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.693828:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad569fa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac191 expref: -99 pid: 81824 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.693840:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad57338 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae5fd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316904.693872:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316904.693878:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0f3d0380 x1853163894134912/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 512/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316904.693982:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894134912:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316904.694123:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.698514:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894134912:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316904.698590:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:1.0:1767316904.698604:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767316904.698634:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.698701:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff9cfe0edb21c8) 00000008:00010000:1.0:1767316904.698737:0:83725:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1767316878 1767316878 1767316877 by oinfo size 4096 blocks 8 [cma]time 1767316878 1767316878 1767316878 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 1/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316904.698847:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.698869:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.698944:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.698951:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.698961:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.698980:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894135040:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.699116:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.702440:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894135040:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.702466:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.702477:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.702488:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.702499:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.702510:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.702517:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.702524:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.702537:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d3b80 x1853163894135040/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.702551:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.702573:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316904.702596:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316904.702627:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316904.702634:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5733f 00000080:00010000:1.0:1767316904.702640:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.702643:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5733f from it ffffa99f40d87b58 00010000:00010000:1.0:1767316904.702647:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.702655:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.702686:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.702698:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=8 00000080:00200008:1.0:1767316904.702711:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f212a.sanity-flr:[0x200000405:0x8e:0x0](ffff9cfe0edb42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.702717:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8),name=f212a.sanity-flr 00000002:00010000:1.0:1767316904.702737:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x8e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.702747:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.702758:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.702765:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.702769:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000080:00010000:1.0:1767316904.702772:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8e:0x0](ffff9cfe0edb42c8) for lock 0xd9a0da65fad56ada 00000080:00010000:1.0:1767316904.702776:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56ada from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316904.702778:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.702797:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.702872:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.702881:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.702886:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.702907:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.702913:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.702917:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.702920:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5733f 00000080:00010000:1.0:1767316904.702923:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5733f from it ffffa99f40d87c10 00010000:00010000:1.0:1767316904.702926:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.702932:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.702940:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.702947:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212a.sanity-flr, flags=0 00000080:00200000:1.0:1767316904.702951:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.702958:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.702964:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.702983:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.702990:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.702994:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.702996:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5733f 00000080:00010000:1.0:1767316904.703000:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5733f from it ffffa99f40d87d68 00010000:00010000:1.0:1767316904.703003:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.703009:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.703019:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316904.703025:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f212a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316904.703051:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.703075:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56ae1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac47e expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316904.703826:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe18f3e680 x1853163894017920/t8589937393(8589937393) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316904.703841:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316904.703846:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11321c00 x1853163894135296/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2216 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316904.703871:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894135296:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316904.704236:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.707020:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894135296:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316904.707058:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe18f3e680 x1853163894017920/t8589937393(8589937393) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 760/848 e 0 to 0 dl 1767316901 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316904.707279:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:0.0:1767316904.707306:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.707320:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x8e:0x0]: losing layout lock 00010000:00010000:0.0:1767316904.707357:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56ae1 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac47e expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.707384:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.707390:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.707397:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1767316904.707400:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d600/0xd9a0da65fad56ae1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac47e expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.707415:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2de00/0xd9a0da65fad56ada lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac470 expref: -99 pid: 82414 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.707429:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2cc00/0xd9a0da65fad5733f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae627 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316904.707448:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316904.707455:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11321c00 x1853163894135552/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 512/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316904.707477:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894135552:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316904.707685:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.712034:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11321c00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894135552:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.712457:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316904.712470:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x8e:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316904.712472:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316904.712479:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316904.712525:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.712534:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x8e:0x0](ffff9cfe0edb42c8) 00000008:00010000:0.0:1767316904.712689:0:83725:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 14 blocks 8 [cma]time: 1767316885 1767316885 0 by oinfo size 14 blocks 8 [cma]time 1767316885 1767316885 1767316885 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aef lrc: 1/0,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac4a1 expref: -99 pid: 82414 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316904.712784:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.712817:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.712871:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.712880:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.712987:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.713013:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894135680:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.713175:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.716439:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894135680:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.716468:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.716482:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.716494:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.716506:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.716536:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.716544:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.716551:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.716643:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe11323100 x1853163894135680/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.716659:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.716672:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316904.716679:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.716713:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.716720:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57346 00000080:00010000:0.0:1767316904.716726:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.716729:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57346 from it ffffa99f40d87b58 00010000:00010000:0.0:1767316904.716733:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.716741:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.716767:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.716785:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=8 00000080:00200008:0.0:1767316904.716797:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f212b.sanity-flr:[0x200000405:0x90:0x0](ffff9cfe187d80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.716803:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8),name=f212b.sanity-flr 00000002:00010000:0.0:1767316904.716840:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.716852:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.716863:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.716869:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.716872:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000080:00010000:0.0:1767316904.716875:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff9cfe187d80c8) for lock 0xd9a0da65fad56c70 00000080:00010000:0.0:1767316904.716878:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad56c70 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316904.716881:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.716886:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.717026:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.717035:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.717042:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.717049:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.717055:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.717064:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.717066:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57346 00000080:00010000:0.0:1767316904.717071:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57346 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316904.717074:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.717374:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.717384:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.717391:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f212b.sanity-flr, flags=0 00000080:00200000:0.0:1767316904.717396:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.717404:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.717410:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.717418:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.717425:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.717429:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.717431:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57346 00000080:00010000:0.0:1767316904.717435:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57346 from it ffffa99f40d87d68 00010000:00010000:0.0:1767316904.717438:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.717444:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.717451:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316904.717464:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f212b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316904.717497:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.717523:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad56c77 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac963 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1767316904.717646:0:83725:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9cfe191dbb80 x1853163894044800/t8589937445(8589937445) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316909 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767316904.717659:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767316904.717666:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11323100 x1853163894135936/t0(0) o35->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:23/10 lens 392/2216 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767316904.717690:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894135936:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1767316904.717845:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.720740:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894135936:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1767316904.720777:0:83725:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9cfe191dbb80 x1853163894044800/t8589937445(8589937445) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 864/952 e 0 to 0 dl 1767316909 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767316904.720828:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:0.0:1767316904.720854:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.720867:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:0.0:1767316904.720873:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.720880:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:0.0:1767316904.720886:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56c4d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ac8de expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.721046:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad56c77 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac963 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.721054:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.721060:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.721066:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56c4d lrc: 1/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac8de expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.721073:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.721162:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 5 locks packed 00010000:00010000:0.0:1767316904.721166:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad56c77 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac963 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.721179:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095000/0xd9a0da65fad56c62 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac90f expref: -99 pid: 83004 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.721266:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713e00/0xd9a0da65fad56c70 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac955 expref: -99 pid: 83008 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.721274:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe27713000/0xd9a0da65fad56c4d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ac8de expref: -99 pid: 83004 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.721286:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57346 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae651 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316904.721313:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316904.721320:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe11323100 x1853163894136192/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 528/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316904.721344:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894136192:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316904.721470:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.726503:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe11323100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894136192:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.726653:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316904.726668:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:0.0:1767316904.726671:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316904.726677:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316904.726705:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.726713:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x90:0x0](ffff9cfe187d80c8) 00000008:00010000:0.0:1767316904.726764:0:83725:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 29 blocks 8 [cma]time: 1767316891 1767316891 0 by oinfo size 29 blocks 8 [cma]time 1767316891 1767316891 0 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c85 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ac994 expref: -99 pid: 83008 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316904.726858:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.726882:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.727036:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.727045:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.727055:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.727126:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894136320:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.727669:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.731671:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894136320:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.731697:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.731709:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.731720:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.731730:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.731741:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.731748:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.731755:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.731766:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191dbb80 x1853163894136320/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.731781:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.731822:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316904.731829:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.731862:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.731869:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5734d 00000080:00010000:0.0:1767316904.731875:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.731878:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5734d from it ffffa99f40d87b58 00010000:00010000:0.0:1767316904.731881:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.731990:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.732017:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.732040:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f2.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316904.732045:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f2.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316904.732070:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f2.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.732659:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.732668:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.732677:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.732701:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894136448:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.732873:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.737393:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894136448:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.737446:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.737468:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.737475:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.737487:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.737497:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.737510:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.737517:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.737524:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.737535:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191dbb80 x1853163894136448/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/1032 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.737547:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 448 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.737645:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.737657:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/32 (0 0) 00000080:00200000:0.0:1767316904.737664:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.737703:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x20:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316904.737769:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x20:0x0], updating i_size 0 00000080:00200000:0.0:1767316904.737796:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x20:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1767316904.737802:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x20:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad57354 00000080:00010000:0.0:1767316904.737820:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x20:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.737825:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57354 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316904.737828:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.737838:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316904.737881:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f2.sanity-flr:[0x200000402:0x20:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.737979:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x20:0x0](ffff9cfe0edc21c8),name=f2.sanity-flr 00000002:00010000:0.0:1767316904.738003:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x20:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.738013:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.738023:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.738029:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.738039:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x20:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.738043:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x20:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad57354 00000080:00010000:0.0:1767316904.738047:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57354 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316904.738051:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.738058:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.744592:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.744625:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.744644:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.744660:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.744668:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.744678:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.744682:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5734d 00000080:00010000:0.0:1767316904.744689:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5734d from it ffffa99f40d87c10 00010000:00010000:0.0:1767316904.744692:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.744701:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.744717:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.744729:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f2.sanity-flr, flags=0 00000080:00200000:0.0:1767316904.744750:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.744758:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.744764:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.744772:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.744779:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.744783:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.744785:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5734d 00000080:00010000:0.0:1767316904.744789:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5734d from it ffffa99f40d87d68 00010000:00010000:0.0:1767316904.744793:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.744800:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.744817:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316904.744823:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f2.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316904.744856:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.744884:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.744980:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x20:0x0]: losing layout lock 00010000:00010000:0.0:1767316904.745022:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.745042:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.745048:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316904.745051:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57354 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae697 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.745073:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5734d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae67b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316904.745115:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316904.745128:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191dbb80 x1853163894136704/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316904.745151:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894136704:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316904.745257:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.749781:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191dbb80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894136704:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.749864:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x20:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316904.749880:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x20:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316904.749883:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316904.749901:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1767316904.749913:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1767316904.749937:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x20:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.749945:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x20:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316904.750051:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.750074:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.750168:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.750425:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.750437:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.750458:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894136832:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.750546:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.753930:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894136832:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.753960:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.753972:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.753983:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.753994:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.754006:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.754012:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.754019:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.754049:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191db100 x1853163894136832/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.754063:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.754077:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316904.754106:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.754133:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.754141:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5735b 00000080:00010000:0.0:1767316904.754146:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.754150:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5735b from it ffffa99f40d87b58 00010000:00010000:0.0:1767316904.754469:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.754479:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.754509:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.754534:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f31.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316904.754539:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f31.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316904.754642:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f31.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.754691:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.754699:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.754709:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.754741:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894136960:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.754851:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.758621:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894136960:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.758649:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.758669:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.758677:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.758687:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.758696:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.758707:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.758714:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.758720:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.758730:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191db100 x1853163894136960/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/824 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.758753:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.758766:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.758775:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/48 (0 0) 00000080:00200000:0.0:1767316904.758782:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.758826:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x30:0x0](ffff9cfe0edc1148) 00000080:00200000:0.0:1767316904.758911:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x30:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:0.0:1767316904.758918:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x30:0x0](ffff9cfe0edc1148) for lock 0xd9a0da65fad57362 00000080:00010000:0.0:1767316904.758929:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x30:0x0](ffff9cfe0edc1148) 00000080:00010000:0.0:1767316904.758933:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57362 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316904.758936:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.758944:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316904.758981:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f31.sanity-flr:[0x200000402:0x30:0x0](ffff9cfe0edc1148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.758988:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x30:0x0](ffff9cfe0edc1148),name=f31.sanity-flr 00000002:00010000:0.0:1767316904.759009:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x30:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.759017:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.759027:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.759044:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.759049:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x30:0x0](ffff9cfe0edc1148) 00000080:00010000:0.0:1767316904.759052:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x30:0x0](ffff9cfe0edc1148) for lock 0xd9a0da65fad57362 00000080:00010000:0.0:1767316904.759056:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57362 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316904.759059:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.759065:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.759113:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x30:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767316904.759124:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x30:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316904.759127:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316904.759131:0:83725:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x30:0x0] 00000008:00010000:0.0:1767316904.759149:0:83725:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316904.759152:0:83725:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc99b0, osc lock ffff9cfe201dbb50, flags 0x400000400001002 00010000:00010000:0.0:1767316904.759399:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57369 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.759409:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57369 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.759420:0:83725:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe191db100 x1853163894137088/t0(0) o101->lustre-OST0000-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1767316904.759453:0:83725:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1767316904.759469:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316904.759487:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894137088:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.762713:0:2502:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57369 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.762737:0:2502:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57369 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6e4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.762750:0:2502:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57369 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae6e4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.762761:0:2502:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57369 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6e4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316904.762775:0:2502:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57369 lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae6e4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316904.762787:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767316904.762816:0:2502:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57369 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae6e4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.762824:0:2502:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57369 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae6e4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.762831:0:2502:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57369 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae6e4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.762838:0:2502:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57369 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae6e4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316904.762879:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894137088:192.168.202.121@tcp:101:rm.0 00000080:00200000:2.0:1767316904.762986:0:83725:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000402:0x30:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1767316904.762992:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe085b36c0 (ffff9cfe0e436e18/0) at cl_lock_release():245 00000020:00010000:2.0:1767316904.762996:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe085b36c0 (ffff9cfe0e436e18/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316904.763010:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc99b0 (ffff9cfe0e4c8128/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316904.763014:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe085b36c0 (ffff9cfe0e436e18/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316904.763017:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc99b0 (ffff9cfe0e436e18/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316904.763029:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x30:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316904.763076:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316904.763137:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.763152:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.763174:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.763190:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316904.763196:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316904.763200:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5735b 00000080:00010000:2.0:1767316904.763205:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5735b from it ffffa99f40d87c10 00010000:00010000:2.0:1767316904.763208:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.763214:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.763223:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316904.763233:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f31.sanity-flr, flags=0 00000080:00200000:2.0:1767316904.763238:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316904.763245:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.763250:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.763267:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.763273:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316904.763277:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316904.763280:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5735b 00000080:00010000:2.0:1767316904.763284:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5735b from it ffffa99f40d87d68 00010000:00010000:2.0:1767316904.763287:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.763294:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.763302:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:2.0:1767316904.763307:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f31.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:2.0:1767316904.763332:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.763354:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316904.763364:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x30:0x0]: losing layout lock 00010000:00010000:2.0:1767316904.763398:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.763405:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.763411:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767316904.763420:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c800/0xd9a0da65fad57362 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae6dd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.763441:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ce00/0xd9a0da65fad5735b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae6c1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767316904.763463:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767316904.763472:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29108380 x1853163894137344/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767316904.763499:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894137344:192.168.202.121@tcp:36:rm.0 00000100:00100000:2.0:1767316904.763590:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316904.767711:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894137344:192.168.202.121@tcp:36:rm.0 00000080:00200000:2.0:1767316904.767773:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x30:0x0] ignore/verify layout 1/0, layout version 2 restore needed 0 00020000:00200000:2.0:1767316904.767784:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x30:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316904.767787:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767316904.767794:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316904.767833:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x30:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316904.767842:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x30:0x0](ffff9cfe0edc1148) 00000008:00010000:2.0:1767316904.767877:0:83725:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57369 lrc: 1/0,0 mode: PR/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae6e4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767316904.767975:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316904.767997:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.768052:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316904.768062:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316904.768112:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316904.768136:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894137472:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316904.768236:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316904.771433:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894137472:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316904.771460:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.771471:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.771481:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.771491:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.771501:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.771508:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.771514:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316904.771524:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe29108000 x1853163894137472/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316904.771563:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.771578:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1767316904.771585:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767316904.771609:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767316904.771615:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57370 00000080:00010000:2.0:1767316904.771621:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316904.771624:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57370 from it ffffa99f40d87b58 00010000:00010000:2.0:1767316904.771628:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.771635:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.771658:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316904.771679:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f33a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:2.0:1767316904.771683:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f33a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:2.0:1767316904.771705:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f33a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.771746:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316904.771753:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316904.771762:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316904.771782:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894137600:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316904.771895:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316904.775835:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894137600:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316904.775862:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.775976:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.775985:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.775998:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.776009:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.776021:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.776029:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.776035:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316904.776047:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe29108000 x1853163894137600/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/824 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316904.776058:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316904.776365:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.776379:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/52 (0 0) 00000080:00200000:2.0:1767316904.776385:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767316904.776421:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x34:0x0](ffff9cfe0eda3a88) 00000080:00200000:2.0:1767316904.776481:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x34:0x0], updating i_size 500 00000080:00200000:2.0:1767316904.776503:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x34:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:2.0:1767316904.776509:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x34:0x0](ffff9cfe0eda3a88) for lock 0xd9a0da65fad57377 00000080:00010000:2.0:1767316904.776520:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x34:0x0](ffff9cfe0eda3a88) 00000080:00010000:2.0:1767316904.776523:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57377 from it ffffa99f40d87b20 00010000:00010000:2.0:1767316904.776527:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.776536:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767316904.776645:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f33a.sanity-flr:[0x200000402:0x34:0x0](ffff9cfe0eda3a88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316904.776652:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x34:0x0](ffff9cfe0eda3a88),name=f33a.sanity-flr 00000002:00010000:2.0:1767316904.776674:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x34:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.776682:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.776692:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316904.776698:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316904.776711:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x34:0x0](ffff9cfe0eda3a88) 00000080:00010000:2.0:1767316904.776714:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x34:0x0](ffff9cfe0eda3a88) for lock 0xd9a0da65fad57377 00000080:00010000:2.0:1767316904.776719:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57377 from it ffffa99f40d87cb8 00010000:00010000:2.0:1767316904.776721:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.776728:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316904.776772:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316904.776780:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.776787:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.776795:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.776800:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316904.776814:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316904.776817:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57370 00000080:00010000:2.0:1767316904.776821:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57370 from it ffffa99f40d87c10 00010000:00010000:2.0:1767316904.776824:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.776830:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.776838:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316904.776848:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f33a.sanity-flr, flags=0 00000080:00200000:2.0:1767316904.776859:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316904.776867:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.776873:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.776881:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.776966:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316904.776971:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316904.776974:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57370 00000080:00010000:2.0:1767316904.776978:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57370 from it ffffa99f40d87d68 00010000:00010000:2.0:1767316904.776981:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.776989:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.776997:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:2.0:1767316904.777003:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f33a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:2.0:1767316904.777026:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.777049:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316904.777059:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x34:0x0]: losing layout lock 00010000:00010000:2.0:1767316904.777366:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.777383:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.777388:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767316904.777391:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095800/0xd9a0da65fad57377 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae72a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.777408:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094c00/0xd9a0da65fad57370 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae70e expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767316904.777426:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767316904.777435:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe29108000 x1853163894137856/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767316904.777457:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894137856:192.168.202.121@tcp:36:rm.0 00000100:00100000:2.0:1767316904.777540:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316904.782675:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894137856:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.782841:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x34:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:0.0:1767316904.782854:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x34:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316904.782857:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316904.782864:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316904.782980:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x34:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.782990:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x34:0x0](ffff9cfe0eda3a88) 00000080:00200000:0.0:1767316904.783456:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.783481:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.783540:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.783550:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.783636:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.783661:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894137984:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.783824:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.787213:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894137984:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.787236:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.787248:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.787282:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.787294:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.787305:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.787313:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.787320:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.787330:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191db100 x1853163894137984/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.787342:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.787355:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316904.787362:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.787388:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.787395:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5737e 00000080:00010000:0.0:1767316904.787400:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.787403:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5737e from it ffffa99f40d87b58 00010000:00010000:0.0:1767316904.787406:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.787418:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.787445:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.787465:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f35.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316904.787470:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f35.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316904.787494:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f35.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.787536:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.787544:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.787552:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.787584:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894138112:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.788371:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.791749:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894138112:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.791776:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.791799:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.791818:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.791847:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.791858:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.791871:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.791878:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.791884:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.791984:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe191db100 x1853163894138112/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/848 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.791994:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 264 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.792008:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.792017:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/254 (0 0) 00000080:00200000:0.0:1767316904.792024:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.792060:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0xfe:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316904.792408:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000402:0xfe:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1767316904.792415:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0xfe:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad57385 00000080:00010000:0.0:1767316904.792436:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xfe:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.792440:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57385 from it ffffa99f40d87b20 00010000:00010000:0.0:1767316904.792443:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.792451:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316904.792501:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f35.sanity-flr:[0x200000402:0xfe:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.792509:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0xfe:0x0](ffff9cfe0edc21c8),name=f35.sanity-flr 00000002:00010000:0.0:1767316904.792533:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0xfe:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.792543:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.792629:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.792637:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.792642:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xfe:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.792646:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0xfe:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad57385 00000080:00010000:0.0:1767316904.792650:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57385 from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316904.792653:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.792661:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.792678:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0xfe:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767316904.792688:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0xfe:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316904.792697:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316904.792702:0:83725:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000402:0xfe:0x0] 00000008:00010000:0.0:1767316904.792720:0:83725:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316904.792723:0:83725:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9d30, osc lock ffff9cfe201dba20, flags 0x400000400001002 00010000:00010000:0.0:1767316904.792768:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5738c lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.792777:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5738c lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.792788:0:83725:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe191db100 x1853163894138240/t0(0) o101->lustre-OST0000-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767316904.792883:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894138240:192.168.202.121@tcp:101:rm.0 00000020:00200000:0.0:1767316904.793131:0:83725:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1767316904.796704:0:2502:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5738c lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.796730:0:2502:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5738c lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae777 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.796764:0:2502:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5738c lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae777 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.796776:0:2502:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5738c lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae777 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316904.796791:0:2502:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 100, setting rss=100; kms=100, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5738c lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae777 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316904.796803:0:2502:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767316904.796826:0:2502:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5738c lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae777 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.796834:0:2502:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5738c lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae777 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.796840:0:2502:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5738c lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae777 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.796848:0:2502:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5738c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae777 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316904.796867:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894138240:192.168.202.121@tcp:101:rm.0 00000080:00200000:0.0:1767316904.797032:0:83725:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000402:0xfe:0x0] updating i_size 100 i_blocks 0 00000020:00010000:0.0:1767316904.797040:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:0.0:1767316904.797044:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316904.797049:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9d30 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316904.797053:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316904.797055:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9d30 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316904.797069:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0xfe:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.797145:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.797176:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.797198:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.797210:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.797217:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.797231:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.797235:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5737e 00000080:00010000:0.0:1767316904.797241:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5737e from it ffffa99f40d87c10 00010000:00010000:0.0:1767316904.797244:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.797250:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.797260:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.797270:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f35.sanity-flr, flags=0 00000080:00200000:0.0:1767316904.797275:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.797282:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.797288:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.797295:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.797301:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.797304:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.797306:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad5737e 00000080:00010000:0.0:1767316904.797309:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5737e from it ffffa99f40d87d68 00010000:00010000:0.0:1767316904.797312:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.797318:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.797325:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316904.797341:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f35.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316904.797367:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.797390:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.797399:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0xfe:0x0]: losing layout lock 00010000:00010000:0.0:1767316904.797431:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.797437:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.797442:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316904.797444:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037d400/0xd9a0da65fad57385 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae770 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.797462:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad5737e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae754 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316904.797480:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316904.797488:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe191db100 x1853163894138496/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316904.797511:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894138496:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316904.798129:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.803472:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe191db100 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894138496:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.803549:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0xfe:0x0] ignore/verify layout 1/0, layout version 3 restore needed 0 00020000:00200000:0.0:1767316904.803576:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0xfe:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316904.803599:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316904.803609:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316904.803649:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0xfe:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.803658:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0xfe:0x0](ffff9cfe0edc21c8) 00000008:00010000:0.0:1767316904.803703:0:83725:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 100 blocks 0 [cma]time: 1767315591 1767315591 1767315590 by oinfo size 100 blocks 0 [cma]time 1767315591 1767315591 1767315590 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5738c lrc: 1/0,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae777 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316904.803796:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.803848:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.803931:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.803940:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.803951:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.803973:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894138624:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.804062:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.807872:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894138624:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.807913:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.807925:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.807937:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.807969:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.807982:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.807990:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.807998:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.808009:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe089faa00 x1853163894138624/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.808021:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.808035:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316904.808044:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.808099:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.808108:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57393 00000080:00010000:0.0:1767316904.808115:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.808118:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57393 from it ffffa99f40d87b58 00010000:00010000:0.0:1767316904.808121:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.808129:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.808176:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.808200:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f36b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316904.808205:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f36b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316904.808229:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f36b.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.808274:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.808281:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.808290:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.808313:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894138752:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.808405:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.812463:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894138752:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.812495:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.812517:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.812525:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.812536:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.812577:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.812589:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.812596:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.812602:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.812612:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe089faa00 x1853163894138752/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/824 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.812623:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1767316904.812636:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.812646:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/263 (0 0) 00000080:00200000:0.0:1767316904.812652:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767316904.812681:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x107:0x0](ffff9cfe0edc21c8) 00000080:00200000:0.0:1767316904.812761:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x107:0x0]: layout version change: 4294967294 -> 5 00000080:00010000:0.0:1767316904.812768:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x107:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad5739a 00000080:00010000:0.0:1767316904.812779:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x107:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.812783:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5739a from it ffffa99f40d87b20 00010000:00010000:0.0:1767316904.812792:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.812799:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:0.0:1767316904.812849:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f36b.sanity-flr:[0x200000402:0x107:0x0](ffff9cfe0edc21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316904.812856:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x107:0x0](ffff9cfe0edc21c8),name=f36b.sanity-flr 00000002:00010000:0.0:1767316904.812877:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x107:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.812885:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.812895:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.812902:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.812906:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x107:0x0](ffff9cfe0edc21c8) 00000080:00010000:0.0:1767316904.812908:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x107:0x0](ffff9cfe0edc21c8) for lock 0xd9a0da65fad5739a 00000080:00010000:0.0:1767316904.812911:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad5739a from it ffffa99f40d87cb8 00010000:00010000:0.0:1767316904.812914:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.812920:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.812936:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x107:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1767316904.812946:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x107:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316904.812950:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1767316904.812960:0:83725:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x107:0x0] 00000008:00010000:0.0:1767316904.812979:0:83725:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767316904.812982:0:83725:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe08cc9d30, osc lock ffff9cfe201dba20, flags 0x400000400001002 00010000:00010000:0.0:1767316904.813031:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad573a1 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.813040:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad573a1 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.813050:0:83725:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe089faa00 x1853163894138880/t0(0) o101->lustre-OST0000-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1767316904.813126:0:83725:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1767316904.813322:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894138880:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.819202:0:2503:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad573a1 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.819228:0:2503:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad573a1 lrc: 6/2,0 mode: --/PR res: [0x2c0000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7c4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.819242:0:2503:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad573a1 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7c4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.819253:0:2503:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad573a1 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7c4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316904.819269:0:2503:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 1048576, setting rss=1048576; kms=1048576, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad573a1 lrc: 5/2,0 mode: PR/PR res: [0x2c0000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae7c4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316904.819281:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767316904.819300:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad573a1 lrc: 6/2,0 mode: PR/PR res: [0x2c0000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae7c4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.819309:0:2503:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad573a1 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae7c4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.819316:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad573a1 lrc: 5/1,0 mode: PR/PR res: [0x2c0000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae7c4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.819323:0:2503:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad573a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae7c4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316904.819363:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894138880:192.168.202.121@tcp:101:rm.0 00000080:00200000:0.0:1767316904.819940:0:83725:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000402:0x107:0x0] updating i_size 1048576 i_blocks 2048 00000020:00010000:0.0:1767316904.819947:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_release():245 00000020:00010000:0.0:1767316904.819951:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767316904.819956:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08cc9d30 (ffff9cfe0e436f38/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767316904.819961:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d14b68 (ffff9cfe0e4c8518/0) at cl_lock_fini():72 00000020:00010000:0.0:1767316904.819963:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08cc9d30 (ffff9cfe0e4c8518/1) at cl_lock_fini():72 00000080:00200000:0.0:1767316904.819976:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x107:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.820023:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.820046:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.820062:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.820075:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.820125:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.820132:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.820145:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57393 00000080:00010000:0.0:1767316904.820152:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57393 from it ffffa99f40d87c10 00010000:00010000:0.0:1767316904.820166:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.820173:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.820193:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.820204:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f36b.sanity-flr, flags=0 00000080:00200000:0.0:1767316904.820210:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.820218:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.820224:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.820232:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.820238:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316904.820242:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.820244:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad57393 00000080:00010000:0.0:1767316904.820248:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad57393 from it ffffa99f40d87d68 00010000:00010000:0.0:1767316904.820252:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.820258:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.820266:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:0.0:1767316904.820279:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f36b.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:0.0:1767316904.820310:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.820334:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767316904.820344:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x107:0x0]: losing layout lock 00010000:00010000:0.0:1767316904.820380:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 1/0,0 mode: --/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.820388:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.820394:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1767316904.820396:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad5739a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae7bd expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767316904.820418:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad57393 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae7a1 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1767316904.820436:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767316904.820446:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe089f8a80 x1853163894139136/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316904.820467:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894139136:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1767316904.820553:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.826149:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894139136:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1767316904.826219:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x107:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:0.0:1767316904.826231:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x107:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1767316904.826251:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1767316904.826258:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316904.826288:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x107:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767316904.826296:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x107:0x0](ffff9cfe0edc21c8) 00000008:00010000:0.0:1767316904.826328:0:83725:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 1048576 blocks 2048 [cma]time: 1767315611 1767315611 0 by oinfo size 1048576 blocks 2048 [cma]time 1767315611 1767315611 0 ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad573a1 lrc: 1/0,0 mode: PR/PR res: [0x2c0000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae7c4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767316904.826422:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:0.0:1767316904.826445:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.826639:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.826648:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.826657:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.826682:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894139264:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.826774:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.833985:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894139264:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.834013:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.834027:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.834039:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.834067:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.834095:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.834101:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.834106:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.834113:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe089f8380 x1853163894139264/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.834123:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.834132:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767316904.834137:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316904.834160:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316904.834164:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad573a8 00000080:00010000:0.0:1767316904.834168:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:0.0:1767316904.834170:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573a8 from it ffffa99f40d87b58 00010000:00010000:0.0:1767316904.834172:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.834177:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316904.834200:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767316904.834216:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f36d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:0.0:1767316904.834219:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f36d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:0.0:1767316904.834237:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f36d.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316904.834276:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.834283:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:0.0:1767316904.834291:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:0.0:1767316904.834311:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894139392:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1767316904.834396:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe18ee4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767316904.838701:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894139392:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.838727:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.838753:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 4/1,0 mode: --/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.838761:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 4/1,0 mode: --/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.838774:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.838803:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.838826:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.838833:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316904.838840:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316904.838850:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe089f8380 x1853163894139392/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/928 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316904.838858:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.838910:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.838923:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/268 (0 0) 00000080:00200000:1.0:1767316904.838930:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316904.838961:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x10c:0x0](ffff9cfe0ed9a1c8) 00000080:00200000:1.0:1767316904.839054:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x10c:0x0]: layout version change: 4294967294 -> 10 00000080:00010000:1.0:1767316904.839061:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x10c:0x0](ffff9cfe0ed9a1c8) for lock 0xd9a0da65fad573af 00000080:00010000:1.0:1767316904.839075:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x10c:0x0](ffff9cfe0ed9a1c8) 00000080:00010000:1.0:1767316904.839095:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573af from it ffffa99f40d87b20 00010000:00010000:1.0:1767316904.839099:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.839108:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767316904.839151:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f36d.sanity-flr:[0x200000402:0x10c:0x0](ffff9cfe0ed9a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.839158:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x10c:0x0](ffff9cfe0ed9a1c8),name=f36d.sanity-flr 00000002:00010000:1.0:1767316904.839182:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x10c:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.839191:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.839201:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.839223:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.839229:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x10c:0x0](ffff9cfe0ed9a1c8) 00000080:00010000:1.0:1767316904.839233:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x10c:0x0](ffff9cfe0ed9a1c8) for lock 0xd9a0da65fad573af 00000080:00010000:1.0:1767316904.839237:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573af from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316904.839240:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.839248:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.839266:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x10c:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1767316904.839278:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x10c:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316904.839281:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316904.839285:0:83725:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x10c:0x0] 00000008:00010000:1.0:1767316904.839303:0:83725:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316904.839306:0:83725:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d790b0, osc lock ffff9cfe09c75b50, flags 0x400000400001002 00010000:00010000:1.0:1767316904.839371:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad573b6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.839379:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad573b6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.839389:0:83725:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe0f3d3b80 x1853163894139520/t0(0) o101->lustre-OST0001-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1767316904.839428:0:83725:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1767316904.839439:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767316904.839457:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894139520:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.844522:0:2503:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad573b6 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.844548:0:2503:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad573b6 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae811 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.844600:0:2503:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad573b6 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae811 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.844611:0:2503:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad573b6 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae811 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767316904.844626:0:2503:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 1024, setting rss=1024; kms=1024, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad573b6 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae811 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767316904.844637:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767316904.844657:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad573b6 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae811 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.844665:0:2503:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad573b6 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae811 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.844671:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad573b6 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae811 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.844679:0:2503:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad573b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae811 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767316904.844715:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894139520:192.168.202.121@tcp:101:rm.0 00000080:00200000:2.0:1767316904.845113:0:83725:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000402:0x10c:0x0] updating i_size 1024 i_blocks 8 00000020:00010000:2.0:1767316904.845120:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d15da8 (ffff9cfe0e4c8908/0) at cl_lock_release():245 00000020:00010000:2.0:1767316904.845123:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d15da8 (ffff9cfe0e4c8908/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767316904.845128:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d790b0 (ffff9cfe0e4c8ea8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767316904.845133:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d15da8 (ffff9cfe0e4c8908/0) at cl_lock_fini():72 00000020:00010000:2.0:1767316904.845136:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d790b0 (ffff9cfe0e4c8908/1) at cl_lock_fini():72 00000080:00200000:2.0:1767316904.845152:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x10c:0x0] ignore/verify layout 0/1, layout version 10 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316904.845215:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316904.845238:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.845253:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.845272:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.845279:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316904.845286:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316904.845289:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad573a8 00000080:00010000:2.0:1767316904.845294:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573a8 from it ffffa99f40d87c10 00010000:00010000:2.0:1767316904.845298:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.845304:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.845314:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316904.845325:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f36d.sanity-flr, flags=0 00000080:00200000:2.0:1767316904.845331:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316904.845338:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.845344:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.845352:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.845358:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316904.845363:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316904.845365:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad573a8 00000080:00010000:2.0:1767316904.845369:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573a8 from it ffffa99f40d87d68 00010000:00010000:2.0:1767316904.845372:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.845384:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.845392:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:2.0:1767316904.845399:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f36d.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:2.0:1767316904.845431:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.845456:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316904.845466:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x10c:0x0]: losing layout lock 00010000:00010000:2.0:1767316904.845502:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 1/0,0 mode: --/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.845509:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.845515:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767316904.845518:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037ca00/0xd9a0da65fad573af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae80a expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.845537:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe1037c600/0xd9a0da65fad573a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae7ee expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767316904.845748:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767316904.845759:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe2910aa00 x1853163894139776/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767316904.845795:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910aa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894139776:192.168.202.121@tcp:36:rm.0 00000100:00100000:2.0:1767316904.846125:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316904.850523:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910aa00 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894139776:192.168.202.121@tcp:36:rm.0 00000080:00200000:2.0:1767316904.850591:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x10c:0x0] ignore/verify layout 1/0, layout version 10 restore needed 0 00020000:00200000:2.0:1767316904.850604:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x10c:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316904.850608:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767316904.850614:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316904.850641:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x10c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316904.850648:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x10c:0x0](ffff9cfe0ed9a1c8) 00000008:00010000:2.0:1767316904.850682:0:83725:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 1024 blocks 8 [cma]time: 1767315635 1767315635 1767315631 by oinfo size 1024 blocks 8 [cma]time 1767315635 1767315635 1767315631 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad573b6 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae811 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767316904.850769:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316904.850789:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.850850:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316904.850858:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316904.850866:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316904.850885:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894139904:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316904.850965:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316904.854696:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894139904:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316904.854735:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.854748:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.854759:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.854770:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.854781:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.854788:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.854795:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316904.854817:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe2910a300 x1853163894139904/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316904.854832:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.854846:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1767316904.854853:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767316904.854879:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767316904.854906:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad573bd 00000080:00010000:2.0:1767316904.854912:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316904.854915:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573bd from it ffffa99f40d87b58 00010000:00010000:2.0:1767316904.854918:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.854926:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.854953:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316904.854974:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f49a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:2.0:1767316904.854979:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f49a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:2.0:1767316904.855002:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f49a.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.855044:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316904.855051:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316904.855060:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316904.855194:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894140032:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316904.855281:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316904.858528:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894140032:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316904.858548:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.858566:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.858586:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.858596:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.858607:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.858619:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.858623:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.858628:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316904.858635:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe2910a300 x1853163894140032/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/824 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316904.858642:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316904.858652:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.858659:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/12 (0 0) 00000080:00200000:2.0:1767316904.858665:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767316904.858694:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0xc:0x0](ffff9cfe0eda1988) 00000080:00200000:2.0:1767316904.858744:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0xc:0x0], updating i_size 1048576 00000080:00200000:2.0:1767316904.858761:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0xc:0x0]: layout version change: 4294967294 -> 5 00000080:00010000:2.0:1767316904.858765:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc:0x0](ffff9cfe0eda1988) for lock 0xd9a0da65fad573c4 00000080:00010000:2.0:1767316904.858774:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc:0x0](ffff9cfe0eda1988) 00000080:00010000:2.0:1767316904.858777:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573c4 from it ffffa99f40d87b20 00010000:00010000:2.0:1767316904.858779:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.858784:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767316904.858832:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f49a.sanity-flr:[0x200000405:0xc:0x0](ffff9cfe0eda1988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316904.858840:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc:0x0](ffff9cfe0eda1988),name=f49a.sanity-flr 00000002:00010000:2.0:1767316904.858862:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0xc:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.858871:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.858882:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316904.858888:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316904.858892:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc:0x0](ffff9cfe0eda1988) 00000080:00010000:2.0:1767316904.858895:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc:0x0](ffff9cfe0eda1988) for lock 0xd9a0da65fad573c4 00000080:00010000:2.0:1767316904.858899:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573c4 from it ffffa99f40d87cb8 00010000:00010000:2.0:1767316904.858902:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.858908:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316904.858962:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316904.858970:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.858976:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.858981:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.858985:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316904.858988:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316904.858989:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad573bd 00000080:00010000:2.0:1767316904.858992:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573bd from it ffffa99f40d87c10 00010000:00010000:2.0:1767316904.858994:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.858998:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.859003:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316904.859009:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f49a.sanity-flr, flags=0 00000080:00200000:2.0:1767316904.859012:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316904.859016:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.859019:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.859023:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.859034:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316904.859036:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316904.859038:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad573bd 00000080:00010000:2.0:1767316904.859040:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573bd from it ffffa99f40d87d68 00010000:00010000:2.0:1767316904.859042:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.859046:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.859051:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:2.0:1767316904.859054:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f49a.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:2.0:1767316904.859070:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.859268:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316904.859276:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0xc:0x0]: losing layout lock 00010000:00010000:2.0:1767316904.859300:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.859305:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.859309:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767316904.859310:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573c4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae857 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.859330:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae83b expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767316904.859343:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767316904.859348:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe2910a300 x1853163894140288/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767316904.859371:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894140288:192.168.202.121@tcp:36:rm.0 00000100:00100000:2.0:1767316904.859495:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316904.864416:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a300 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894140288:192.168.202.121@tcp:36:rm.0 00000080:00200000:2.0:1767316904.864492:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0xc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1767316904.864507:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0xc:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1767316904.864510:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1767316904.864518:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767316904.864550:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0xc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767316904.864558:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0xc:0x0](ffff9cfe0eda1988) 00000080:00200000:2.0:1767316904.864664:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316904.864686:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.864740:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316904.864748:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316904.864755:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316904.864771:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894140416:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316904.865549:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316904.870364:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894140416:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316904.870396:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.871344:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.871363:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.871375:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.871390:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.871397:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.871404:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316904.871417:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe29108700 x1853163894140416/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316904.871431:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.871444:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1767316904.871470:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767316904.871497:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767316904.871569:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad573cb 00000080:00010000:2.0:1767316904.871576:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:2.0:1767316904.871579:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573cb from it ffffa99f40d87b58 00010000:00010000:2.0:1767316904.871582:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.871590:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316904.871614:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767316904.871687:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f5.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:2.0:1767316904.871692:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f5.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:2.0:1767316904.871714:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f5.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.871757:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316904.871765:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:2.0:1767316904.871774:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:2.0:1767316904.871798:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894140544:192.168.202.121@tcp:101:rm.0 00000100:00100000:2.0:1767316904.871978:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe20255f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767316904.877355:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894140544:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316904.877383:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.877433:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.877440:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.877451:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.877461:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.877473:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.877480:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316904.877488:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316904.877500:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe29108700 x1853163894140544/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/928 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316904.877511:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 344 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767316904.877524:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.877545:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/38 (0 0) 00000080:00200000:2.0:1767316904.877552:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767316904.877589:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x26:0x0](ffff9cfe0eda1988) 00000080:00200000:2.0:1767316904.877675:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x26:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1767316904.877681:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x26:0x0](ffff9cfe0eda1988) for lock 0xd9a0da65fad573d2 00000080:00010000:2.0:1767316904.877692:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x26:0x0](ffff9cfe0eda1988) 00000080:00010000:2.0:1767316904.877695:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573d2 from it ffffa99f40d87b20 00010000:00010000:2.0:1767316904.877697:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.877705:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767316904.877740:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f5.sanity-flr:[0x200000402:0x26:0x0](ffff9cfe0eda1988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316904.877746:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x26:0x0](ffff9cfe0eda1988),name=f5.sanity-flr 00000002:00010000:2.0:1767316904.877767:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x26:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316904.877775:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.877785:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316904.877792:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316904.877796:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x26:0x0](ffff9cfe0eda1988) 00000080:00010000:2.0:1767316904.877799:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x26:0x0](ffff9cfe0eda1988) for lock 0xd9a0da65fad573d2 00000080:00010000:2.0:1767316904.877803:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573d2 from it ffffa99f40d87cb8 00010000:00010000:2.0:1767316904.877815:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767316904.877829:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767316904.877848:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x26:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:2.0:1767316904.877860:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x26:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 3 00020000:00200000:2.0:1767316904.877863:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1767316904.877868:0:83725:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x26:0x0] 00000008:00010000:2.0:1767316904.877885:0:83725:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767316904.877889:0:83725:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe0322f0b0, osc lock ffff9cfe2013d560, flags 0x400000400001002 00010000:00010000:2.0:1767316904.877940:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573d9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316904.877949:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573d9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316904.877959:0:83725:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe29108700 x1853163894140672/t0(0) o101->lustre-OST0001-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:2.0:1767316904.877999:0:83725:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1767316904.878042:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894140672:192.168.202.121@tcp:101:rm.0 00010000:00010000:2.0:1767316904.883018:0:2504:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573d9 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316904.883062:0:2504:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573d9 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8a4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316904.883078:0:2504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573d9 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae8a4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316904.883132:0:2504:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573d9 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8a4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767316904.883149:0:2504:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 12345, setting rss=12345; kms=12345, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573d9 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae8a4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767316904.883323:0:2504:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1767316904.883341:0:2504:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573d9 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae8a4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316904.883350:0:2504:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573d9 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae8a4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316904.883357:0:2504:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573d9 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae8a4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316904.883365:0:2504:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae8a4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767316904.883386:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894140672:192.168.202.121@tcp:101:rm.0 00000080:00200000:1.0:1767316904.883492:0:83725:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000402:0x26:0x0] updating i_size 12345 i_blocks 0 00000020:00010000:1.0:1767316904.883500:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d15da8 (ffff9cfe0e4c8908/0) at cl_lock_release():245 00000020:00010000:1.0:1767316904.883503:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d15da8 (ffff9cfe0e4c8908/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316904.883508:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe0322f0b0 (ffff9cfe0e4c8ea8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316904.883513:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d15da8 (ffff9cfe0e4c8908/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316904.883516:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe0322f0b0 (ffff9cfe0e4c8908/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316904.883531:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x26:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.883582:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.883604:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.883617:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.883628:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.883635:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.883642:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.883646:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad573cb 00000080:00010000:1.0:1767316904.883652:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573cb from it ffffa99f40d87c10 00010000:00010000:1.0:1767316904.883655:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.883662:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.883686:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.883699:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f5.sanity-flr, flags=0 00000080:00200000:1.0:1767316904.883704:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.883711:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.883717:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.883724:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.883729:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.883733:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.883735:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad573cb 00000080:00010000:1.0:1767316904.883738:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573cb from it ffffa99f40d87d68 00010000:00010000:1.0:1767316904.883740:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.883746:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.883754:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316904.883760:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f5.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316904.883787:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.883823:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.883848:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x26:0x0]: losing layout lock 00010000:00010000:1.0:1767316904.883886:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.883893:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.883899:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316904.883903:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094200/0xd9a0da65fad573d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae89d expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.883923:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094000/0xd9a0da65fad573cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae881 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316904.883943:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316904.883954:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0f3d3b80 x1853163894140928/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316904.883981:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894140928:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316904.884957:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.891057:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894140928:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316904.891141:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x26:0x0] ignore/verify layout 1/0, layout version 3 restore needed 0 00020000:00200000:1.0:1767316904.891153:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x26:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 3 00020000:00200000:1.0:1767316904.891156:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316904.891163:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00000080:00200000:1.0:1767316904.891191:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x26:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.891199:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x26:0x0](ffff9cfe0eda1988) 00000008:00010000:1.0:1767316904.891262:0:83725:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 12345 blocks 0 [cma]time: 0 0 0 by oinfo size 12345 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573d9 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae8a4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767316904.891351:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.891390:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.891449:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.891456:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.891466:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.891554:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894141056:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.891646:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.896749:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894141056:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.896782:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.896796:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.896817:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.896829:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.896841:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.896863:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.896870:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.896881:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d0700 x1853163894141056/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.896895:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.896910:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316904.896917:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316904.896949:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316904.896956:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad573e0 00000080:00010000:1.0:1767316904.896963:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.896967:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573e0 from it ffffa99f40d87b58 00010000:00010000:1.0:1767316904.896971:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.896980:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.897010:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.897035:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f72.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316904.897040:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f72.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316904.897066:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f72.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.897865:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.897875:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.897885:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.897907:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894141184:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.898102:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.903564:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894141184:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.903591:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.903612:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x57:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.903620:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.903871:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.903881:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.903981:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.903989:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.904011:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.904025:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d0700 x1853163894141184/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/1344 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.904039:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 760 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.904052:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.904062:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935621/87 (0 0) 00000080:00200000:1.0:1767316904.904069:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316904.904131:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000405:0x57:0x0](ffff9cfe0ed9db88) 00000080:00200000:1.0:1767316904.904246:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000405:0x57:0x0], updating i_size 3145728 00000080:00200000:1.0:1767316904.904277:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000405:0x57:0x0]: layout version change: 4294967294 -> 15 00000080:00010000:1.0:1767316904.904283:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x57:0x0](ffff9cfe0ed9db88) for lock 0xd9a0da65fad573e7 00000080:00010000:1.0:1767316904.904293:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x57:0x0](ffff9cfe0ed9db88) 00000080:00010000:1.0:1767316904.904297:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573e7 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316904.904301:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.904309:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767316904.904784:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f72.sanity-flr:[0x200000405:0x57:0x0](ffff9cfe0ed9db88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.904794:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x57:0x0](ffff9cfe0ed9db88),name=f72.sanity-flr 00000002:00010000:1.0:1767316904.904856:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000405:0x57:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.904866:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.904877:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.904884:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.904979:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x57:0x0](ffff9cfe0ed9db88) 00000080:00010000:1.0:1767316904.904983:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000405:0x57:0x0](ffff9cfe0ed9db88) for lock 0xd9a0da65fad573e7 00000080:00010000:1.0:1767316904.904988:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573e7 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316904.904992:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.905000:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.905048:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.905057:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.905064:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.905072:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.905231:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.905237:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.905239:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad573e0 00000080:00010000:1.0:1767316904.905243:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573e0 from it ffffa99f40d87c10 00010000:00010000:1.0:1767316904.905252:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.905258:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.905265:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.905274:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f72.sanity-flr, flags=0 00000080:00200000:1.0:1767316904.905278:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.905285:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.905291:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.905298:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.905304:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.905307:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.905310:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad573e0 00000080:00010000:1.0:1767316904.905313:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573e0 from it ffffa99f40d87d68 00010000:00010000:1.0:1767316904.905315:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.905321:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.905328:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316904.905333:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f72.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316904.905365:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.905400:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.905410:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000405:0x57:0x0]: losing layout lock 00010000:00010000:1.0:1767316904.905443:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.905449:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.905454:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316904.905456:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573e7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae8ea expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.905473:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae8ce expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316904.905492:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316904.905503:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0f3d0700 x1853163894141440/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316904.905530:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894141440:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316904.905641:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.910733:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894141440:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316904.910797:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x57:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316904.910825:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000405:0x57:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316904.910828:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316904.910849:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1767316904.910860:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x10 00020000:00200000:1.0:1767316904.910865:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[2] flags 0x10 00020000:00200000:1.0:1767316904.910869:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[3] flags 0x0 00000080:00200000:1.0:1767316904.910892:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x57:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.910900:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000405:0x57:0x0](ffff9cfe0ed9db88) 00000080:00200000:1.0:1767316904.911050:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.911071:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.911159:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.911169:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.911178:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.911251:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894141568:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.911340:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.915024:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894141568:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.915049:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.915061:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.915072:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.915121:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.915155:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.915163:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.915171:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.915191:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d1500 x1853163894141568/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.915206:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.915220:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1767316904.915227:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767316904.915255:0:83725:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1767316904.915262:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad573ee 00000080:00010000:1.0:1767316904.915267:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.915271:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573ee from it ffffa99f40d87b58 00010000:00010000:1.0:1767316904.915274:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.915281:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.915313:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.915346:0:83725:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f7.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), flags=8 00000080:00200000:1.0:1767316904.915350:0:83725:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f7.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148), intent=getattr 00000002:00010000:1.0:1767316904.915372:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f7.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.915415:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.915422:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00010000:00010000:1.0:1767316904.915432:0:83725:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 83725 initiator: MDT0 00000100:00100000:1.0:1767316904.915451:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894141696:192.168.202.121@tcp:101:rm.0 00000100:00100000:1.0:1767316904.915530:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.919897:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894141696:192.168.202.121@tcp:101:rm.0 00010000:00010000:1.0:1767316904.919923:0:83725:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.919946:0:83725:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.919954:0:83725:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.919965:0:83725:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.919975:0:83725:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.920007:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.920016:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.920023:0:83725:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767316904.920036:0:83725:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9cfe0f3d1500 x1853163894141696/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 584/1008 e 0 to 0 dl 1767316920 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767316904.920047:0:83725:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 424 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1767316904.920058:0:83725:0:(mdc_locks.c:969:mdc_finish_enqueue()) ### DoM lock is returned by: getattr, size: 0 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1767316904.920068:0:83725:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.920077:0:83725:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9cfe10358c00 type 13 mode 4 res 8589935618/40 (0 0) 00000080:00200000:1.0:1767316904.920125:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1767316904.920157:0:83725:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x28:0x0](ffff9cfe0ed9db88) 00000080:00200000:1.0:1767316904.920261:0:83725:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x28:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:1.0:1767316904.920267:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x28:0x0](ffff9cfe0ed9db88) for lock 0xd9a0da65fad573f5 00000080:00010000:1.0:1767316904.920279:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x28:0x0](ffff9cfe0ed9db88) 00000080:00010000:1.0:1767316904.920282:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573f5 from it ffffa99f40d87b20 00010000:00010000:1.0:1767316904.920292:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.920301:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200008:1.0:1767316904.920343:0:83725:0:(file.c:6252:ll_getattr_dentry()) START file f7.sanity-flr:[0x200000402:0x28:0x0](ffff9cfe0ed9db88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767316904.920352:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x28:0x0](ffff9cfe0ed9db88),name=f7.sanity-flr 00000002:00010000:1.0:1767316904.920375:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x28:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.920384:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.920394:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.920399:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.920404:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x28:0x0](ffff9cfe0ed9db88) 00000080:00010000:1.0:1767316904.920406:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x28:0x0](ffff9cfe0ed9db88) for lock 0xd9a0da65fad573f5 00000080:00010000:1.0:1767316904.920410:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573f5 from it ffffa99f40d87cb8 00010000:00010000:1.0:1767316904.920412:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.920419:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.920438:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x28:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1767316904.920448:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x28:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316904.920451:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1767316904.920455:0:83725:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x28:0x0] 00000008:00010000:1.0:1767316904.920478:0:83725:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767316904.920481:0:83725:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9cfe09d790b0, osc lock ffff9cfe09c75b50, flags 0x400000400001002 00010000:00010000:1.0:1767316904.920526:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573fc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.920535:0:83725:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573fc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316904.920546:0:83725:0:(ldlm_request.c:1054:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff9cfe0f3d1500 x1853163894141824/t0(0) o101->lustre-OST0001-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1767316904.920576:0:83725:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1767316904.920736:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894141824:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1767316904.923820:0:2503:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573fc lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.923845:0:2503:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573fc lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae937 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.923859:0:2503:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573fc lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae937 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.923890:0:2503:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573fc lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae937 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767316904.923906:0:2503:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573fc lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x10020000000000 nid: local remote: 0x863eb2f6655ae937 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767316904.923916:0:2503:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767316904.923936:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573fc lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae937 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.923950:0:2503:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573fc lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae937 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.923958:0:2503:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573fc lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x810020000000000 nid: local remote: 0x863eb2f6655ae937 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316904.923967:0:2503:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae937 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767316904.923986:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894141824:192.168.202.121@tcp:101:rm.0 00000080:00200000:1.0:1767316904.924127:0:83725:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000402:0x28:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1767316904.924134:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9cfe08d15da8 (ffff9cfe0e4c8908/0) at cl_lock_release():245 00000020:00010000:1.0:1767316904.924137:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe08d15da8 (ffff9cfe0e4c8908/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767316904.924142:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9cfe09d790b0 (ffff9cfe0e4c8758/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767316904.924147:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe08d15da8 (ffff9cfe0e4c8908/0) at cl_lock_fini():72 00000020:00010000:1.0:1767316904.924150:0:83725:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9cfe09d790b0 (ffff9cfe0e4c8908/1) at cl_lock_fini():72 00000080:00200000:1.0:1767316904.924162:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x28:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.924290:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.924313:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.924328:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.924340:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.924347:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.924354:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.924357:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad573ee 00000080:00010000:1.0:1767316904.924371:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573ee from it ffffa99f40d87c10 00010000:00010000:1.0:1767316904.924374:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.924381:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.924391:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 1 00000080:00200000:1.0:1767316904.924404:0:83725:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f7.sanity-flr, flags=0 00000080:00200000:1.0:1767316904.924410:0:83725:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:1.0:1767316904.924418:0:83725:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316904.924424:0:83725:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.924432:0:83725:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.924437:0:83725:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767316904.924440:0:83725:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) 00000080:00010000:1.0:1767316904.924442:0:83725:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9cfe0edd1148) for lock 0xd9a0da65fad573ee 00000080:00010000:1.0:1767316904.924445:0:83725:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd9a0da65fad573ee from it ffffa99f40d87d68 00010000:00010000:1.0:1767316904.924448:0:83725:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.924454:0:83725:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767316904.924461:0:83725:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148), inode mode 41ed mask 3 00000080:00200000:1.0:1767316904.924467:0:83725:0:(namei.c:2354:ll_unlink()) VFS Op:name=f7.sanity-flr, dir=[0x200000007:0x1:0x0](ffff9cfe0edd1148) 00010000:00010000:1.0:1767316904.924498:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.924521:0:83725:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767316904.924536:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x28:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00000080:00200000:1.0:1767316904.924544:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x28:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.924700:0:83725:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x28:0x0]: losing layout lock 00010000:00010000:1.0:1767316904.924739:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.924747:0:83725:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316904.924752:0:83725:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1767316904.924755:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2c600/0xd9a0da65fad573f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae930 expref: -99 pid: 83725 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767316904.924774:0:83725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe03c2ca00/0xd9a0da65fad573ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x863eb2f6655ae914 expref: -99 pid: 83725 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1767316904.924792:0:83725:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9cfe08c17800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767316904.924813:0:83725:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9cfe0f3d2d80 x1853163894142080/t0(0) o36->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 496/2216 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316904.924841:0:83725:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894142080:192.168.202.121@tcp:36:rm.0 00000100:00100000:1.0:1767316904.925059:0:83725:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe086ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1767316904.929794:0:83725:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job rm:9a586faf-b087-472d-9665-d3bc7d15b908:83725:1853163894142080:192.168.202.121@tcp:36:rm.0 00000080:00200000:1.0:1767316904.929878:0:83725:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x28:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767316904.929993:0:83725:0:(lov_io.c:458:lov_io_mirror_init()) [0x200000402:0x28:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1767316904.929997:0:83725:0:(lov_io.c:484:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1767316904.930004:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1767316904.930016:0:83725:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1767316904.930037:0:83725:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x28:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767316904.930045:0:83725:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x28:0x0](ffff9cfe0ed9db88) 00000008:00010000:1.0:1767316904.930169:0:83725:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573fc lrc: 1/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x800020000000000 nid: local remote: 0x863eb2f6655ae937 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767316905.029225:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316906.053442:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316906.179772:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316906.179986:0:42041:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1767316906.180007:0:42041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939855872 00000100:00100000:3.0:1767316906.180016:0:42041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939855872 00000100:00100000:3.0:1767316906.180076:0:42041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10265 00000100:00100000:3.0:1767316906.180105:0:42041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29095450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:19258:x1853163939855872:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316906.180123:0:42041:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x863eb2f6655ad5cd expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316906.180187:0:42041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316906.180194:0:42041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29095450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:19258:x1853163939855872:12345-192.168.202.121@tcp:104: Request processed in 91us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316906.180201:0:42041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10265 00010000:00010000:0.0:1767316906.180375:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316906.180385:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x863eb2f6655ad5cd expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316906.180394:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05095600 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316906.180417:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x863eb2f6655ad5cd expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316906.180466:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655ad5cd expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316906.180474:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316906.180512:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655ad5cd expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316906.180521:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe05095600/0xd9a0da65fad56f79 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655ad5cd expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316906.180542:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316906.180544:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316906.180545:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316906.180553:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316906.180568:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894142208:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316906.181203:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2505:1853163894142336:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316906.181257:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894142592:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316906.181286:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1767316906.181302:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894142464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316906.181329:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894142720:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316906.187865:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894142208:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767316906.193193:0:2505:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9cfe08c17800: committing for last_committed 8589937602 gen 1 00000100:00100000:3.0:1767316906.193392:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894142464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316906.193408:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894142720:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316906.193417:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2505:1853163894142336:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316906.193425:0:2505:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9cfe08c17800: committing for last_committed 4294975999 gen 1 00000100:00100000:3.0:1767316906.193521:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894142592:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316906.238997:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316906.239052:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939860864 00000100:00100000:2.0:1767316906.239062:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939860864 00000100:00100000:2.0:1767316906.239175:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10266 00000100:00100000:2.0:1767316906.239193:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29108700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:51198:x1853163939860864:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316906.239211:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x420000010000 nid: local remote: 0x863eb2f6655ad5d4 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316906.239320:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316906.239327:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29108700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:51198:x1853163939860864:12345-192.168.202.121@tcp:104: Request processed in 137us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316906.239335:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10266 00010000:00010000:0.0:1767316906.243659:0:63840:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316906.243672:0:63840:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x420000010000 nid: local remote: 0x863eb2f6655ad5d4 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316906.243786:0:63840:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe05094a00 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316906.243803:0:63840:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x428400010000 nid: local remote: 0x863eb2f6655ad5d4 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316906.243861:0:63840:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655ad5d4 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316906.243880:0:63840:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316906.243924:0:63840:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655ad5d4 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316906.243931:0:63840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05094a00/0xd9a0da65fad56f80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655ad5d4 expref: -99 pid: 83727 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316906.243954:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316906.243955:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316906.243957:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316906.243970:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767316906.243993:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894142848:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316906.264438:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894142848:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767316907.080424:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767316908.104907:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1767316908.166304:0:83999:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-flr: finish cleanup 20:21:46 (1767316906) === 00010000:00010000:1.0:1767316909.124744:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316910.149418:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316910.228530:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316910.228572:0:2497:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1767316910.228604:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939865216 00000100:00100000:2.0:1767316910.228614:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939865216 00000100:00100000:2.0:1767316910.228657:0:56325:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939865344 00000100:00100000:2.0:1767316910.228660:0:56325:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939865344 00000100:00100000:2.0:1767316910.228674:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10267 00000100:00100000:2.0:1767316910.228682:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe29109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:19258:x1853163939865216:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316910.228700:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x420000010000 nid: local remote: 0x863eb2f6655ae444 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316910.228821:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767316910.228828:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe29109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:19258:x1853163939865216:12345-192.168.202.121@tcp:104: Request processed in 147us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316910.228836:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10267 00000100:00100000:2.0:1767316910.228853:0:56325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10268 00000100:00100000:2.0:1767316910.228860:0:56325:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:19257:x1853163939865344:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1767316910.228867:0:56325:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x863eb2f6655ae3f0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767316910.228927:0:56325:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1767316910.228933:0:56325:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:19257:x1853163939865344:12345-192.168.202.121@tcp:104: Request processed in 74us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316910.228939:0:56325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10268 00010000:00010000:0.0:1767316910.229219:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1767316910.229227:0:59093:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x420000010000 nid: local remote: 0x863eb2f6655ae444 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316910.229236:0:59093:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c400 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316910.229242:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x428400010000 nid: local remote: 0x863eb2f6655ae444 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316910.229291:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655ae444 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316910.229299:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316910.229320:0:59093:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655ae444 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316910.229335:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c400/0xd9a0da65fad572dd lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655ae444 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316910.229360:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316910.229364:0:59093:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x863eb2f6655ae3f0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316910.229370:0:59093:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037c200 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316910.229374:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x863eb2f6655ae3f0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316910.229393:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655ae3f0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316910.229400:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316910.229406:0:59093:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655ae3f0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316910.229414:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037c200/0xd9a0da65fad572c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655ae3f0 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316910.229426:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316910.229427:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316910.229429:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316910.229483:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316910.229501:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894142976:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316910.229584:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316910.229591:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894143104:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316910.236754:0:2496:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1767316910.237336:0:42040:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853163939865728 00000100:00100000:3.0:1767316910.237346:0:42040:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853163939865728 00000100:00100000:3.0:1767316910.237405:0:42040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 10269 00000100:00100000:3.0:1767316910.237416:0:42040:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfe2910aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:18360:x1853163939865728:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1767316910.237433:0:42040:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x863eb2f6655ae43d expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767316910.237523:0:42040:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767316910.237529:0:42040:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfe2910aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:18360:x1853163939865728:12345-192.168.202.121@tcp:104: Request processed in 116us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316910.237537:0:42040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 10269 00010000:00010000:0.0:1767316910.237828:0:42049:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316910.237839:0:42049:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x863eb2f6655ae43d expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316910.237864:0:42049:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9cfe1037d800 already unused, calling callback (ffffffffc12b70e0) 00010000:00010000:0.0:1767316910.237871:0:42049:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x863eb2f6655ae43d expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316910.237922:0:42049:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655ae43d expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316910.237929:0:42049:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316910.237948:0:42049:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655ae43d expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316910.237956:0:42049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe1037d800/0xd9a0da65fad572d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x863eb2f6655ae43d expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767316910.237977:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316910.237979:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316910.237980:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316910.237988:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316910.238002:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894143232:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316910.243764:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894142976:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767316910.243804:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894143104:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1767316910.247677:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894143232:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767316911.172456:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0:1767316911.300513:0:36:0:(vvp_io.c:1854:vvp_io_init()) [0x200000405:0x8b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767316911.300543:0:36:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767316911.300575:0:36:0:(vvp_io.c:289:vvp_io_fini()) [0x200000405:0x8b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:1.0:1767316911.300821:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2503:1853163894143360:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316911.300943:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894143616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316911.300973:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894143872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316911.301002:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1767316911.301009:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894143488:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316911.301041:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894143744:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316911.317389:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894143616:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767316911.319710:0:2503:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-mdc-ffff9cfe08c17800 of lustre-MDT0000_UUID@192.168.202.121@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1767316911.319731:0:2503:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1767316911.319737:0:2503:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-mdc-ffff9cfe08c17800: Connection to lustre-MDT0000 (at 192.168.202.121@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1767316911.343935:0:2503:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767316911.343950:0:2503:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 1188 00000100:00080000:1.0:1767316911.343973:0:2503:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767316911.343986:0:2503:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767316911.344019:0:2503:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1880 x1853163894144000/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316911.344050:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894143488:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316911.344131:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894143744:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316911.344148:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894143872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316911.350117:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894144000:192.168.202.121@tcp:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1767316911.352504:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767316911.352520:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767316911.352534:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894144000:192.168.202.121@tcp:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1767316912.201529:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767316913.224901:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316914.244246:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316915.268477:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316916.294291:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767316916.421291:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316916.421299:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767316916.421303:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767316916.421313:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2162 00000100:00080000:0.0:1767316916.421325:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1767316916.421333:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767316916.421343:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767316916.421362:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb480 x1853163894144256/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316916.421469:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894144384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316916.421566:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894144640:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316916.421600:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1767316916.421606:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2503:1853163894144128:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316916.421630:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894144512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316916.424130:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894144256:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767316916.439790:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767316916.439809:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767316916.439814:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894144256:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767316916.439917:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894144512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316916.439929:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894144384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316916.439939:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894144640:192.168.202.121@tcp:400:kworker.0 00010000:00010000:1.0:1767316917.316331:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316918.341472:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316919.365927:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316920.390226:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767316921.414739:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767316921.541587:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767316921.541603:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767316921.541608:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767316921.541618:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2167 00000100:00080000:1.0:1767316921.541628:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1767316921.541647:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767316921.542495:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767316921.542530:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2680 x1853163894144896/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767316921.542625:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894144896:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767316921.543306:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2502:1853163894144768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316921.543378:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894145152:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316921.543435:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1767316921.543443:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894145024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316921.543470:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894145280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316921.551931:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894145280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316921.551953:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894145152:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316921.552514:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894145024:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767316921.553113:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767316921.553122:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767316921.553127:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894144896:192.168.202.121@tcp:38:kworker.0 00010000:00010000:1.0:1767316922.437015:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316923.460397:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316924.484421:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316925.509104:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316926.534413:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767316926.662176:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767316926.662184:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767316926.662188:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767316926.662200:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2172 00000100:00080000:3.0:1767316926.662223:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1767316926.662230:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767316926.662241:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767316926.662259:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4380 x1853163894145536/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316926.662381:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894145536:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767316926.662439:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2505:1853163894145408:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316926.662693:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894145664:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316926.663198:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894145792:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316926.663378:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894145920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316926.667969:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894145664:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316926.667993:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894145920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316926.668122:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894145792:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767316926.672134:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767316926.672152:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767316926.672157:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894145536:192.168.202.121@tcp:38:kworker.0 00010000:00010000:0.0:1767316927.556328:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1767316927.620259:0:2503:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767316911/real 1767316911] req@ffff9cfe089f9500 x1853163894143360/t0(0) o400->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 224/224 e 0 to 1 dl 1767316927 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767316927.665505:0:2503:0:(client.c:2522:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9cfe089f9500 x1853163894143360/t0(0) o400->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 224/224 e 0 to 1 dl 1767316927 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767316927.665524:0:2503:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1767316927.665528:0:2503:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.202.121@tcp: Connection to MGS (at 192.168.202.121@tcp) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1767316927.680672:0:2503:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@192.168.202.121@tcp for MGC192.168.202.121@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1767316927.680676:0:2503:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1767316927.680685:0:2503:0:(client.c:3559:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cfe089f9500 x1853163894143360/t0(0) o400->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 224/224 e 0 to 1 dl 1767316927 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767316927.680696:0:2503:0:(client.c:3559:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cfe089fbb80 x1853163894144128/t0(0) o400->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 224/224 e 0 to 0 dl 1767316932 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767316927.680702:0:2503:0:(client.c:3559:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cfe0f3d3480 x1853163894144768/t0(0) o400->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 224/224 e 0 to 0 dl 1767316937 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767316927.680771:0:2503:0:(client.c:3559:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cfe18fd7b80 x1853163894145408/t0(0) o400->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 224/224 e 0 to 0 dl 1767316942 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1767316927.680788:0:2503:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1767316927.680790:0:2503:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1767316927.680791:0:2503:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1767316927.680793:0:2503:0:(import.c:416:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1767316927.680998:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2505:1853163894145408:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767316927.683202:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767316927.683210:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767316927.683214:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767316927.683236:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 1188 00000100:00080000:2.0:1767316927.683249:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767316927.683275:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894146048/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767316927.683297:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767316927.683299:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767316927.683301:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767316927.683303:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2178 00000100:00080000:2.0:1767316927.683305:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767316927.683308:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767316927.683317:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767316927.683328:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894146176/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767316927.683873:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894146048:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767316927.683992:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2503:1853163894144128:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316927.684010:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2503:1853163894143360:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316927.685313:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894146432:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316927.685418:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1767316927.685426:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894146304:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316927.685454:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894146560:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316927.688256:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2502:1853163894144768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316927.693148:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894146176:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767316927.698736:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894146304:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316927.698758:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894146560:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316927.698783:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894146432:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767316927.706985:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767316927.707000:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767316927.707005:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894146176:192.168.202.121@tcp:38:kworker.0 00010000:00010000:0.0:1767316928.580557:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316929.607269:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316930.628243:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316931.654808:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316932.677765:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767316932.806823:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767316932.806833:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767316932.806836:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767316932.806840:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767316932.806844:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767316932.806853:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2179 00000100:00080000:3.0:1767316932.806865:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767316932.806872:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767316932.806883:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767316932.806917:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894146688/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316932.807850:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894146688:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767316932.808582:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894146816:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316932.808629:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894147072:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316932.808667:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767316932.808824:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894146944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316932.812915:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894146816:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767316932.817571:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767316932.817587:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767316932.817592:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894146944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316932.817594:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894146688:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767316932.817610:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894147072:192.168.202.121@tcp:400:kworker.0 00010000:00010000:1.0:1767316933.700630:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316934.724560:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316935.748797:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316936.773897:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767316937.799194:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316937.925502:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767316927/real 1767316927] req@ffff9cfe29108000 x1853163894146048/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767316937 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767316937.925545:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29108000 x1853163894146048/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767316937 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767316937.925567:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767316937.925571:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316937.925576:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767316937.925579:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767316937.925583:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2179 00000100:00080000:1.0:1767316937.925583:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767316937.925587:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894146048:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767316937.925593:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1767316937.925604:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767316937.926806:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb100 x1853163894147200/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316937.926865:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894147200:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767316937.927183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316937.927188:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767316937.927190:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767316937.927195:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2184 00000100:00080000:0.0:1767316937.927199:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767316937.927206:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767316937.927215:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767316937.927551:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8000 x1853163894147328/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316937.927596:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894147328:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767316937.927725:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894147456:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316937.927756:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894147712:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316937.927990:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894147584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316937.929849:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894147456:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767316937.929943:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767316937.929948:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767316937.929958:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894147328:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767316937.932243:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894147712:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316937.933731:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894147584:192.168.202.121@tcp:400:kworker.0 00010000:00010000:2.0:1767316938.829214:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316939.844317:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316940.869064:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316941.892248:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316942.917514:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767316943.045435:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316943.045444:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767316943.045447:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316943.045451:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767316943.045455:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767316943.045476:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2189 00000100:00080000:0.0:1767316943.045488:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767316943.045496:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767316943.045508:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767316943.046028:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9500 x1853163894147840/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316943.046311:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894147968:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316943.046524:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894148096:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316943.046607:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894148224:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316943.055893:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894147840:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767316943.064825:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767316943.064841:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767316943.064860:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894147840:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767316943.068833:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894148096:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316943.073417:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894148224:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316943.073436:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894147968:192.168.202.121@tcp:400:kworker.0 00010000:00010000:0.0:1767316943.946295:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316944.972313:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1767316945.710699:0:84523:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: auster : @@@@@@ FAIL: Restart of mds1 failed! 00010000:00010000:3.0:1767316945.989036:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316947.015939:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316948.039760:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767316948.168602:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767316948.168613:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767316948.168616:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767316948.168620:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767316948.168624:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767316948.168634:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2194 00000100:00080000:1.0:1767316948.168643:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767316948.168650:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767316948.168661:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767316948.168693:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3480 x1853163894148352/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316948.168784:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894148480:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316948.168903:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894148736:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316948.168941:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316948.168948:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894148608:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316948.177769:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894148352:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767316948.195454:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894148608:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316948.195475:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894148480:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316948.195485:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894148736:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767316948.243072:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767316948.243114:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767316948.243119:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894148352:192.168.202.121@tcp:38:kworker.0 00010000:00010000:2.0:1767316949.061155:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316950.084262:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:2.0:1767316950.988999:0:84855:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff9cfe0edd1148), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316950.989015:0:84855:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9cfe0edd1148),name=/ 00000002:00010000:2.0:1767316950.989038:0:84855:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316950.989822:0:84855:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad57403 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 84855 initiator: MDT0 00010000:00010000:2.0:1767316950.989836:0:84855:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad57403 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 84855 initiator: MDT0 00010000:00010000:2.0:1767316950.989847:0:84855:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9cfe08c17800 lock: ffff9cfe05094600/0xd9a0da65fad57403 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 84855 initiator: MDT0 00000100:00080000:2.0:1767316950.989875:0:84855:0:(client.c:1829:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9cfe2910ad80 x1853163894148864/t0(0) o101->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 576/4336 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1767316950.989894:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316951.108481:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316952.004260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316952.132436:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316952.260260:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767316937/real 1767316937] req@ffff9cfe089fb100 x1853163894147200/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767316952 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767316952.260297:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fb100 x1853163894147200/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767316952 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767316952.260318:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767316952.260351:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767316952.260356:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894147200:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767316952.260471:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316952.260476:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767316952.260479:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767316952.260485:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2189 00000100:00080000:0.0:1767316952.260494:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1767316952.260501:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767316952.260534:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fbb80 x1853163894148992/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767316952.260558:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316952.260563:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767316952.260565:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767316952.260568:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2199 00000100:00080000:0.0:1767316952.260571:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767316952.260575:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767316952.260584:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767316952.260595:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8700 x1853163894149120/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316952.260653:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894149248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316952.260760:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894149504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316952.260790:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316952.260796:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894149376:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316952.260883:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894148992:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767316952.260926:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894149120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767316952.273431:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894149376:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767316952.280408:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767316952.280425:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767316952.280430:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894149120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767316952.283002:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894149248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316952.283033:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894149504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316953.030770:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767316953.156507:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316954.052741:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767316954.183370:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316955.076227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767316955.207034:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316956.100241:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316956.231767:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316957.124313:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316957.252583:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767316957.380925:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316957.380936:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767316957.380939:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316957.380943:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767316957.380947:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767316957.380956:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2203 00000100:00080000:0.0:1767316957.380967:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767316957.380973:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767316957.380984:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767316957.381018:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9c00 x1853163894149632/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316957.381171:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894149632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767316957.381304:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894149760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316957.381345:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767316957.381351:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894149888:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316957.381673:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316957.381682:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894150016:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316957.386600:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894149888:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316957.386725:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894150016:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767316957.391701:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767316957.391718:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767316957.391724:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894149632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767316957.391913:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894149760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316958.149974:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767316958.276767:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316959.172626:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316959.301001:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316960.196170:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316960.328928:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316961.220262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767316961.348293:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316962.244184:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767316962.372864:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767316962.501332:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767316962.501345:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767316962.501349:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767316962.501353:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767316962.501359:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767316962.501371:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2208 00000100:00080000:3.0:1767316962.501383:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767316962.501390:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767316962.501402:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767316962.501438:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894150144/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767316962.501538:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894150400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316962.501658:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1767316962.501666:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894150272:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316962.501695:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894150528:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316962.502426:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894150144:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767316962.516346:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894150272:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316962.516385:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894150400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316962.516706:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894150528:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767316962.516814:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767316962.516822:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767316962.516826:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894150144:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767316963.268373:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767316963.396661:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316964.292249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316964.424315:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316965.316212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316965.444495:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316966.340226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767316966.468556:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316967.368841:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316967.495759:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767316967.622890:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316967.622900:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767316967.622922:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316967.622927:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767316967.622931:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767316967.622941:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2213 00000100:00080000:0.0:1767316967.622953:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767316967.622961:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767316967.622974:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767316967.623010:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9180 x1853163894150656/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767316967.623136:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894150656:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767316967.624424:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894150784:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316967.624493:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894151040:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316967.624525:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767316967.624532:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894150912:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767316967.632028:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767316967.632043:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767316967.632048:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894150656:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767316967.638741:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894151040:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316967.638782:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894150912:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316967.638796:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894150784:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316968.389435:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316968.516347:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316969.412279:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767316969.540326:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316970.436567:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767316970.572146:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316971.462238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767316971.592822:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316972.484232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316972.614263:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767316972.740311:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316972.740331:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767316972.740353:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316972.740357:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767316972.740360:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767316972.740370:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2218 00000100:00080000:0.0:1767316972.740381:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767316972.740388:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767316972.740398:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767316972.740430:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894151168/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316972.740527:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894151424:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316972.740640:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1767316972.740648:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894151296:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316972.740675:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894151552:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316972.741248:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767316952/real 1767316952] req@ffff9cfe089fbb80 x1853163894148992/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767316972 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767316972.741272:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fbb80 x1853163894148992/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767316972 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767316972.741286:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894151168:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767316972.741343:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767316972.741361:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767316972.741365:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894148992:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767316972.741664:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316972.741669:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767316972.741671:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767316972.741676:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2203 00000100:00080000:0.0:1767316972.741681:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1767316972.741686:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767316972.741706:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8380 x1853163894151680/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767316972.742014:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894151680:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767316972.750721:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767316972.750737:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767316972.750741:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894151168:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767316972.751866:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894151296:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316972.751891:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894151552:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316972.751898:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894151424:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316973.508728:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316973.639180:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316974.532279:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767316974.660314:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316975.556225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316975.684636:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316976.580376:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316976.709333:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316977.604338:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767316977.732401:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767316977.860192:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316977.860201:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767316977.860204:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767316977.860208:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767316977.860212:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767316977.860221:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2224 00000100:00080000:0.0:1767316977.860231:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767316977.860239:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767316977.860250:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767316977.860301:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8a80 x1853163894151808/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767316977.860386:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894152064:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316977.860498:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1767316977.860504:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894151936:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316977.860531:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894152192:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316977.860673:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894151808:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767316977.865185:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894152192:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316977.865207:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894152064:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316977.867470:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894151936:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767316977.868045:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767316977.868054:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767316977.868059:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894151808:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767316978.628272:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767316978.758221:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316979.652432:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767316979.780420:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316980.676364:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316980.804737:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316981.703241:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316981.828586:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316981.956619:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894152320:192.168.202.121@tcp:17:kworker.0 00000100:00100000:0.0:1767316981.967649:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894152320:192.168.202.121@tcp:17:kworker.0 00000100:00100000:2.0:1767316982.724268:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767316982.852537:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767316982.980465:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767316982.980476:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767316982.980479:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767316982.980483:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767316982.980487:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767316982.980497:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2229 00000100:00080000:3.0:1767316982.980507:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767316982.980514:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767316982.980525:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767316982.980561:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894152448/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767316982.980652:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894152704:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316982.980749:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1767316982.980756:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894152576:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316982.980782:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894152832:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316982.980990:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894152448:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767316982.983320:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894152576:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316982.983354:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894152832:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316982.983364:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894152704:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767316982.983601:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767316982.983608:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767316982.983612:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894152448:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767316983.750315:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316983.878943:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316984.772255:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316984.901645:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316985.796236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767316985.924287:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316986.820246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767316986.952688:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316987.844308:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767316987.972360:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767316988.100336:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767316988.100347:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767316988.100349:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767316988.100353:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767316988.100376:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767316988.100387:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2234 00000100:00080000:1.0:1767316988.100456:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767316988.100464:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767316988.100477:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767316988.100507:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1880 x1853163894152960/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767316988.100567:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894152960:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767316988.100883:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894153088:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767316988.100931:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894153216:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316988.101305:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894153344:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767316988.110666:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767316988.110679:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767316988.110684:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894152960:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767316988.112191:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894153216:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316988.112297:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894153088:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316988.112309:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894153344:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316988.868230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316989.000961:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316989.892282:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316990.020342:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316990.916749:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767316991.044243:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316991.940973:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316992.068584:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316992.964240:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316993.092641:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767316993.221046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767316993.221057:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767316993.221060:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767316993.221063:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767316993.221068:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767316993.221078:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2239 00000100:00080000:2.0:1767316993.221131:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767316993.221138:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767316993.221149:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767316993.221198:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894153472/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767316993.221290:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894153728:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316993.221392:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1767316993.221399:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894153600:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316993.221427:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894153856:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316993.221917:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894153472:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767316993.231300:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767316993.231315:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767316993.231321:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894153472:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767316993.231944:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894153600:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316993.232045:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894153728:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316993.242782:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894153856:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316993.988194:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767316994.116463:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316995.013542:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767316995.149902:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316996.036284:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767316996.164378:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316997.060218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316997.192292:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316997.317876:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767316972/real 1767316972] req@ffff9cfe089f8380 x1853163894151680/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767316997 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767316997.317940:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089f8380 x1853163894151680/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767316997 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767316997.317982:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767316997.318189:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767316997.318196:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767316997.318200:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00080000:3.0:1767316997.318200:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767316997.318210:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2224 00000100:00080000:3.0:1767316997.318218:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1767316997.318225:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894151680:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767316997.318228:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767316997.318263:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894153984/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767316997.318301:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767316997.318304:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767316997.318313:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767316997.318317:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2244 00000100:00080000:3.0:1767316997.318321:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767316997.318326:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767316997.318335:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767316997.318347:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894154112/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767316997.318420:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894154368:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316997.318502:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1767316997.318509:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894154240:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316997.318548:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894154496:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767316997.319966:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894153984:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767316997.320099:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894154112:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767316997.326536:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767316997.326553:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767316997.326558:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894154112:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767316997.327211:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894154368:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316997.327754:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894154496:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767316997.332559:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894154240:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767316998.084576:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767316998.213379:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316999.115227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767316999.236263:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317000.132736:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317000.260256:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317001.159716:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317001.285272:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317002.182443:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317002.308306:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317002.437787:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317002.437796:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317002.437799:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317002.437803:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317002.437807:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317002.437815:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2248 00000100:00080000:0.0:1767317002.437825:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317002.437846:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317002.437856:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317002.437885:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa680 x1853163894154624/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317002.438136:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894154752:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317002.438248:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894155008:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317002.438283:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317002.438290:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894154880:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317002.438947:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894154624:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317002.444532:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894154880:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317002.444549:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894155008:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317002.446606:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894154752:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317002.448108:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317002.448120:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317002.448126:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894154624:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317003.204872:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317003.332678:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317004.229200:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317004.357323:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317005.252218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317005.380343:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317006.276274:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317006.404782:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317007.300238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317007.428256:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317007.556356:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317007.556366:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317007.556369:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317007.556373:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317007.556377:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317007.556388:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2253 00000100:00080000:3.0:1767317007.556419:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317007.556427:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317007.556439:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317007.556469:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894155136/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317007.556619:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894155264:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317007.556743:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894155520:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317007.556777:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317007.556783:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894155392:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317007.559007:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894155136:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317007.562687:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894155520:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317007.565751:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317007.565767:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317007.565772:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894155136:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317007.566152:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894155392:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317007.566165:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894155264:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317008.324211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317008.452385:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317009.348705:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317009.476389:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317010.373454:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317010.500607:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317011.396590:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317011.525199:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317012.424212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317012.548596:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317012.676979:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317012.676989:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317012.676992:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317012.676995:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317012.676999:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317012.677010:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2258 00000100:00080000:3.0:1767317012.677021:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317012.677028:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317012.677039:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317012.677071:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6680 x1853163894155648/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317012.677361:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894155776:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317012.677471:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894156032:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317012.677503:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317012.677508:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894155904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317012.677545:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894155648:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317012.688813:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317012.688844:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317012.688852:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894155904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317012.688853:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894155648:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317012.688879:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894155776:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317012.688893:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894156032:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317013.444568:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317013.572381:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317014.468689:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317014.596380:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317015.493184:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317015.620638:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317016.516612:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317016.646646:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317017.540699:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317017.668395:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317017.799101:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317017.799112:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317017.799115:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317017.799119:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317017.799139:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317017.799149:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2264 00000100:00080000:3.0:1767317017.799159:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317017.799166:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317017.799177:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317017.799207:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894156160/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317017.800167:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894156160:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317017.800280:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894156288:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317017.800321:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894156544:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317017.800347:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317017.800354:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894156416:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317017.806465:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894156416:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317017.806481:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894156288:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317017.806490:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894156544:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317017.806649:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317017.806656:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317017.806661:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894156160:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317018.564273:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317018.697531:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317019.588289:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317019.716485:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317020.612198:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317020.740333:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317021.636320:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317021.764379:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317022.660402:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317022.788421:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317022.916707:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317022.916716:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317022.916719:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317022.916722:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317022.916727:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317022.916737:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2269 00000100:00080000:1.0:1767317022.916757:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317022.916764:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317022.916776:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317022.916819:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3b80 x1853163894156672/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317022.916959:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767316997/real 1767316997] req@ffff9cfe18fd7800 x1853163894153984/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317022 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767317022.917017:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd7800 x1853163894153984/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317022 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767317022.917039:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894156672:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767317022.917320:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317022.917340:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767317022.917344:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894153984:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767317022.917640:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894156928:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317022.917693:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1767317022.917700:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894156800:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317022.917727:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894157056:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317022.919880:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317022.919894:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317022.919898:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317022.919906:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2248 00000100:00080000:1.0:1767317022.919914:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317022.919920:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767317022.919951:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1180 x1853163894157184/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317022.920174:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894157184:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767317022.948964:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894156800:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317022.949001:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894157056:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317022.949011:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894156928:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317022.949325:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317022.949337:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317022.949341:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894156672:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317023.684292:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317023.812273:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317024.708299:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317024.836881:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317025.734369:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317025.860529:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317026.756215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317026.884880:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317027.781131:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317027.908728:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317028.038019:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317028.038040:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317028.038043:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317028.038046:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317028.038051:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317028.038061:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2274 00000100:00080000:3.0:1767317028.038071:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317028.038077:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317028.038127:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317028.038167:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4380 x1853163894157312/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317028.038592:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894157312:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317028.038601:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894157440:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317028.038745:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894157696:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317028.038784:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317028.038791:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894157568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317028.045542:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894157568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317028.045563:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894157696:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317028.050441:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894157440:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317028.052520:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317028.052535:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317028.052540:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894157312:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317028.804330:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317028.933100:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317029.829225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317029.956430:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317030.852272:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317030.980499:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317031.876230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317032.005178:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317032.900295:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317033.028954:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317033.156398:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317033.156428:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317033.156431:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317033.156435:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317033.156439:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317033.156449:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2279 00000100:00080000:3.0:1767317033.156460:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317033.156476:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317033.156487:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317033.156519:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894157824/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317033.156611:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894157952:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317033.156878:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894158080:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317033.157004:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894157824:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317033.157791:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894158208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317033.167187:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894158080:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317033.170014:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317033.170027:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317033.170253:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894157824:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317033.179299:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894157952:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317033.179324:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894158208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317033.924236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317034.052941:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317034.949064:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317035.076588:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317035.981270:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317036.102193:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317036.996378:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317037.125117:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317038.021179:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317038.148444:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317038.279456:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317038.279465:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317038.279468:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317038.279471:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317038.279487:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317038.279496:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2284 00000100:00080000:3.0:1767317038.279507:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317038.279513:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317038.279524:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317038.279553:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894158336/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317038.279757:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894158464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317038.279854:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894158720:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317038.279890:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317038.279896:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894158592:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317038.280125:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894158336:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317038.287161:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894158592:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317038.287174:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894158464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317038.287182:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894158720:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317038.297939:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317038.297955:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317038.297960:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894158336:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317039.044212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317039.172240:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317040.068219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317040.196344:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317041.092270:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317041.220532:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317042.119401:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317042.244261:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317043.140239:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317043.268796:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317043.399592:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317043.399602:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317043.399605:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317043.399609:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317043.399613:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317043.399622:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2289 00000100:00080000:1.0:1767317043.399633:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317043.399640:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317043.399650:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317043.399685:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3b80 x1853163894158848/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317043.399787:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894158848:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317043.400817:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894158976:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317043.400877:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894159232:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317043.400909:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317043.400915:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894159104:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317043.405767:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894159104:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317043.405786:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894158976:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317043.405807:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894159232:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317043.407529:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317043.408265:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317043.408271:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894158848:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317044.164282:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317044.293105:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317045.188220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317045.316558:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317046.212306:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317046.340694:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317047.236760:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317047.366153:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317047.492274:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317022/real 1767317022] req@ffff9cfe0f3d1180 x1853163894157184/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317047 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317047.492307:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d1180 x1853163894157184/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317047 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317047.492329:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317047.492353:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767317047.492357:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894157184:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767317047.492442:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317047.492447:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317047.492450:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317047.492456:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2274 00000100:00080000:3.0:1767317047.492465:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317047.492473:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767317047.492505:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894159360/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317047.492555:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317047.492558:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317047.492561:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317047.492565:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2294 00000100:00080000:3.0:1767317047.492569:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317047.492573:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317047.492582:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317047.492594:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894159488/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317047.492596:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894159360:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767317047.492658:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894159744:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317047.492683:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894159488:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317047.492689:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1767317047.492694:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894159616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317047.492714:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894159872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317047.496440:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894159616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317047.496460:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894159872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317047.496470:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894159744:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317047.496594:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317047.496601:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317047.496604:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894159488:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317048.260271:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317048.388265:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317049.284541:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317049.412393:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317050.308227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317050.436458:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317051.335017:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317051.460549:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317052.356750:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317052.487105:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317052.612737:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317052.612745:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317052.612748:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317052.612752:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317052.612756:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317052.612766:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2298 00000100:00080000:0.0:1767317052.612778:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317052.612785:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317052.612797:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317052.612833:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9f80 x1853163894160000/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317052.612884:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894160000:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317052.613298:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894160256:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317052.613342:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1767317052.613349:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894160128:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317052.613376:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894160384:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317052.616033:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317052.616047:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317052.616051:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894160000:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317052.621570:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894160128:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317052.621591:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894160384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317052.621602:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894160256:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317053.380412:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317053.508609:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317054.404383:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317054.532340:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317055.428532:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317055.559264:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317056.452261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317056.580917:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317057.476167:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317057.604336:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317057.732718:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317057.732729:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317057.732732:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317057.732751:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317057.732755:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317057.732765:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2303 00000100:00080000:3.0:1767317057.732775:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317057.732781:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317057.732790:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317057.732820:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4380 x1853163894160512/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317057.732879:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894160512:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317057.733069:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894160640:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317057.733759:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894160896:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317057.733793:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317057.733799:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894160768:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317057.740052:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317057.740070:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317057.740076:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894160512:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317057.740958:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894160768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317057.740973:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894160640:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317057.741002:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894160896:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317058.501851:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317058.628454:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317059.524371:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317059.652277:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317060.548642:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317060.678950:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317061.572217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317061.700509:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317062.596224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317062.724287:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317062.852299:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317062.852311:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317062.852314:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317062.852318:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317062.852323:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317062.852333:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2309 00000100:00080000:1.0:1767317062.852345:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317062.852371:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317062.852424:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317062.852454:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1180 x1853163894161024/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317062.852528:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894161280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317062.852694:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894161024:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317062.852797:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894161152:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317062.862907:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894161408:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317062.866893:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317062.866909:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317062.866914:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894161024:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317062.866978:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894161152:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317062.867300:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894161280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317062.867721:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894161408:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317063.620303:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317063.748715:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317064.644203:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317064.772269:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317065.670497:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317065.796809:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317066.693601:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317066.820992:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317067.716668:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317067.845001:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317067.972969:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317067.972984:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317067.972987:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317067.972991:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317067.972996:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317067.973010:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2314 00000100:00080000:1.0:1767317067.973023:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317067.973031:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317067.973049:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317067.973101:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1f80 x1853163894161536/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317067.973167:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894161536:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317067.973897:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894161664:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317067.973939:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894161920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317067.973962:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317067.973980:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894161792:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317067.988393:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317067.988422:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317067.988427:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894161536:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317067.988601:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894161792:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317067.988612:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894161664:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317067.988620:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894161920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317068.742115:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317068.873012:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317069.764236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317069.892309:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317070.788209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317070.918074:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317071.812672:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317071.940335:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317072.070459:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317047/real 1767317047] req@ffff9cfe18fd5880 x1853163894159360/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317072 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317072.070500:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd5880 x1853163894159360/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317072 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317072.070521:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317072.070552:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767317072.070558:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894159360:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767317072.070815:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317072.070821:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767317072.070824:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317072.070849:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2298 00000100:00080000:2.0:1767317072.070858:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317072.070864:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767317072.070900:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894162048/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767317072.070926:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317072.070930:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317072.070932:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317072.070936:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2319 00000100:00080000:2.0:1767317072.070940:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317072.070943:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317072.070951:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317072.070962:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894162176/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317072.071036:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894162432:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317072.071152:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1767317072.071159:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894162304:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317072.071258:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894162048:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767317072.074520:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894162176:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317072.081811:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317072.081828:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317072.081834:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894162176:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317072.084418:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894162304:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317072.084437:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894162560:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317072.084545:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894162432:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317072.093759:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894162560:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317072.836218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317072.967046:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317073.860202:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317073.988468:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317074.885975:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317075.012570:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317075.908212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317076.037109:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317076.932233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317077.060472:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317077.188541:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317077.188550:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317077.188553:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317077.188557:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317077.188561:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317077.188572:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2323 00000100:00080000:3.0:1767317077.188584:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317077.188590:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317077.188624:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317077.188655:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894162688/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317077.188740:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894162944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317077.188840:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1767317077.188847:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894162816:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317077.188873:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894163072:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317077.189100:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894162688:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317077.194630:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894162816:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317077.194650:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894163072:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317077.194661:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894162944:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317077.194770:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317077.194777:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317077.194781:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894162688:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317077.958659:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317078.085748:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317078.980325:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317079.108507:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317080.004624:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317080.132631:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317081.028208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317081.156251:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317082.054331:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317082.183397:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317082.308336:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317082.308347:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317082.308350:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317082.308354:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317082.308358:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317082.308368:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2328 00000100:00080000:0.0:1767317082.308379:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317082.308403:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317082.308413:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317082.308464:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089faa00 x1853163894163200/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317082.309994:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894163328:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317082.310180:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894163584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317082.310229:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317082.310237:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894163456:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317082.310760:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894163200:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317082.320675:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894163456:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317082.320694:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894163584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317082.324648:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894163328:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317082.330144:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317082.330162:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317082.330167:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894163200:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317083.076305:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317083.206843:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317084.100250:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317084.228418:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317085.124295:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317085.252979:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317086.148338:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317086.276820:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317087.172326:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317087.303852:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317087.428444:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317087.428459:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317087.428462:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317087.428466:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317087.428472:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317087.428487:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2333 00000100:00080000:1.0:1767317087.428502:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317087.428538:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317087.428553:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317087.428605:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1180 x1853163894163712/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317087.428702:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894163712:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317087.428726:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894163968:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317087.428857:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894163840:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317087.441073:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894164096:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317087.446831:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894163840:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317087.448059:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894164096:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317087.448062:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894163968:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317087.449335:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317087.449354:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317087.449361:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894163712:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317088.196534:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317088.324643:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317089.220526:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317089.349525:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317090.244358:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317090.373459:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317091.268609:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317091.396466:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317092.292334:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317092.420958:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317092.550811:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317092.550826:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317092.550830:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317092.550835:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317092.550840:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317092.550853:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2338 00000100:00080000:3.0:1767317092.550868:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317092.550875:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317092.550891:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317092.550938:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894164224/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317092.551061:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894164480:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317092.551064:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894164352:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317092.551346:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894164608:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317092.551500:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894164224:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317092.560895:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894164352:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317092.560920:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894164608:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317092.560976:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894164480:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317092.561035:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317092.561043:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317092.561048:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894164224:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317093.316267:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317093.444815:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317094.341187:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317094.469392:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317095.364249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317095.493582:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317096.388221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317096.521912:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317097.412273:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317097.540282:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317097.669365:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317072/real 1767317072] req@ffff9cfe29108e00 x1853163894162048/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317097 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767317097.669411:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29108e00 x1853163894162048/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317097 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767317097.669437:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317097.669464:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767317097.669470:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894162048:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767317097.670297:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317097.670328:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317097.670332:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317097.670339:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2323 00000100:00080000:3.0:1767317097.670352:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317097.670370:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767317097.670413:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894164736/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317097.670442:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317097.670446:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317097.670448:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317097.670452:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2343 00000100:00080000:3.0:1767317097.670455:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317097.670460:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317097.670472:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317097.670489:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894164864/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317097.670560:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894164992:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317097.670674:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894165248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317097.670705:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317097.670710:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894165120:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317097.672215:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894164736:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767317097.672337:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894164864:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317097.680960:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894165120:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317097.680981:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894164992:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317097.680993:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894165248:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317097.681117:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317097.681125:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317097.681130:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894164864:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317098.436271:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317098.567310:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317099.460753:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317099.591243:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317100.484195:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317100.616181:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317101.508331:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317101.640743:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317102.534162:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317102.660368:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317102.788411:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317102.788427:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317102.788450:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317102.788455:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317102.788461:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317102.788476:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2349 00000100:00080000:3.0:1767317102.788492:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317102.788501:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317102.788517:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317102.788562:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894165376/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317102.788725:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894165632:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317102.788838:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894165504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317102.788879:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894165376:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317102.788887:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894165760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317102.796198:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894165632:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317102.800517:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894165760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317102.802202:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894165504:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317102.803246:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317102.803261:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317102.803267:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894165376:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317103.556251:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317103.684991:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317104.580396:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317104.708455:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317105.604346:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317105.732339:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317106.629952:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317106.756352:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317107.652225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317107.780611:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317107.911189:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317107.911204:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317107.911208:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317107.911213:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317107.911219:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317107.911232:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2354 00000100:00080000:3.0:1767317107.911259:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317107.911269:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317107.911285:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317107.911336:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894165888/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317107.911611:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894166016:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317107.911754:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894166272:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317107.911799:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317107.911805:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894166144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317107.913935:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894165888:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317107.914795:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894166144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317107.914813:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894166272:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317107.925835:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317107.925850:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317107.925856:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894165888:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317107.926033:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894166016:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317108.676650:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317108.807500:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317109.700277:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317109.828320:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317110.724291:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317110.853406:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317111.748810:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317111.877019:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317112.772215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317112.900635:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317113.028274:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317113.028285:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317113.028288:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317113.028292:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317113.028296:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317113.028306:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2359 00000100:00080000:3.0:1767317113.028317:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317113.028324:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317113.028335:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317113.028369:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4380 x1853163894166400/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317113.028645:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894166400:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317113.028887:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317113.028899:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894166528:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317113.033992:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894166784:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317113.034340:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317113.034349:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894166656:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317113.037752:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894166528:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317113.037809:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894166656:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317113.037821:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894166784:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317113.043547:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317113.043562:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317113.043567:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894166400:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317113.796237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317113.925161:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317114.823368:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317114.948653:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317115.845272:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317115.972306:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317116.868289:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317117.000234:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317117.892250:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317118.020575:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317118.148719:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317118.148732:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317118.148736:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317118.148820:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317118.148825:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317118.148835:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2364 00000100:00080000:0.0:1767317118.148847:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317118.148924:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317118.148936:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317118.148968:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894166912/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317118.149050:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894167168:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317118.149184:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1767317118.149192:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894167040:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317118.149596:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894167296:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317118.150359:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894166912:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317118.151946:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894167168:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317118.152622:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894167296:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317118.153352:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894167040:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317118.153447:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317118.153453:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317118.153457:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894166912:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317118.918578:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317119.044892:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317119.940217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317120.068285:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317120.964581:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317121.097193:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317121.990566:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317122.119522:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317122.244317:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317097/real 1767317097] req@ffff9cfe18fd5180 x1853163894164736/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317122 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317122.244356:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd5180 x1853163894164736/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317122 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317122.244394:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317122.244424:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767317122.244430:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894164736:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767317122.244515:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317122.244521:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317122.244524:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317122.244530:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2349 00000100:00080000:3.0:1767317122.244540:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317122.244548:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767317122.244579:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894167424/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317122.244605:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317122.244609:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317122.244611:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317122.244614:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2369 00000100:00080000:3.0:1767317122.244618:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317122.244621:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317122.244631:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317122.244640:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894167552/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317122.244712:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894167808:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317122.244800:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1767317122.244807:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894167680:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317122.244831:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894167936:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317122.245028:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894167424:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767317122.245071:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894167552:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317122.251488:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894167808:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317122.251534:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894167680:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317122.251549:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894167936:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317122.253120:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317122.253137:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317122.253143:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894167552:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317123.012300:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317123.140408:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317124.036228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317124.164679:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317125.060701:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317125.188409:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317126.085736:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317126.212399:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317127.108227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317127.236489:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317127.366008:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317127.366019:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317127.366022:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317127.366025:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317127.366030:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317127.366040:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2373 00000100:00080000:1.0:1767317127.366063:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317127.366071:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317127.366099:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317127.366132:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2300 x1853163894168064/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317127.366213:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894168320:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317127.366330:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1767317127.366336:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894168192:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317127.366356:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894168448:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317127.366449:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894168064:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317127.370267:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894168448:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317127.376822:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317127.376837:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317127.376843:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894168064:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317127.376912:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894168192:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317127.376925:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894168320:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317128.132652:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317128.263005:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317129.156301:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317129.286211:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317130.180225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317130.310672:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317131.204676:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317131.332988:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317132.228235:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317132.359547:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317132.484394:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317132.484405:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317132.484408:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317132.484411:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317132.484416:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317132.484427:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2378 00000100:00080000:0.0:1767317132.484438:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317132.484463:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317132.484475:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317132.484510:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fbb80 x1853163894168576/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317132.484592:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894168832:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317132.484696:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1767317132.484704:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894168704:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317132.484732:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894168960:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317132.484991:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894168576:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317132.492716:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317132.492733:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317132.492739:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894168576:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317132.493857:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894168832:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317132.493879:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894168704:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317132.493889:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894168960:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317133.252225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317133.380633:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317134.276237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317134.404362:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317135.302272:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317135.428458:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317136.326788:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317136.452441:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317137.348515:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317137.476659:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317137.606007:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317137.606038:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317137.606042:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317137.606046:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317137.606049:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317137.606059:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2383 00000100:00080000:3.0:1767317137.606071:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317137.606077:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317137.606119:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317137.606213:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894169088/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317137.606314:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894169344:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317137.606556:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894169088:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317137.606946:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894169216:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317137.606980:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894169472:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317137.615675:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894169472:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317137.618054:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894169216:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317137.621420:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317137.621438:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317137.621458:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894169088:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317137.621558:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894169344:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317138.372382:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317138.500345:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317139.396231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317139.524499:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317140.420362:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317140.552241:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317141.444343:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317141.573118:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317142.468292:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317142.598140:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317142.724444:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317142.724454:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317142.724457:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317142.724461:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317142.724465:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317142.724475:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2388 00000100:00080000:1.0:1767317142.724487:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317142.724590:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317142.724602:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317142.724638:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2a00 x1853163894169600/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317142.724718:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894169600:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317142.725299:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894169856:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317142.725353:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1767317142.725361:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894169728:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317142.725386:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894169984:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317142.732580:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894169728:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317142.732599:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894169984:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317142.732607:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894169856:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317142.732788:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317142.732796:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317142.732799:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894169600:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317143.492412:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317143.620372:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317144.520003:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317144.645146:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317145.540243:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317145.668739:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317146.564256:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317146.692798:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317147.588277:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317147.716401:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317147.844264:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317122/real 1767317122] req@ffff9cfe18fd4e00 x1853163894167424/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317147 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317147.844299:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd4e00 x1853163894167424/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317147 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317147.844319:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317147.844327:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767317147.844331:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894167424:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767317147.845929:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317147.845938:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767317147.845942:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317147.845950:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2373 00000100:00080000:2.0:1767317147.845961:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317147.845969:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767317147.846005:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894170112/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767317147.846037:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317147.846041:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317147.846043:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317147.846046:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2394 00000100:00080000:2.0:1767317147.846050:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317147.846054:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317147.846062:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317147.846112:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894170240/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317147.846192:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894170368:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317147.846291:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894170624:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317147.846327:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317147.846334:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894170496:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317147.846925:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894170112:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767317147.846980:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894170240:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317147.851612:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894170368:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317147.854433:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317147.854448:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317147.854454:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894170240:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317147.854981:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894170624:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317147.855118:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894170496:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317148.612228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317148.740355:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317149.637178:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317149.764337:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317150.660236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317150.788412:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317151.684525:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317151.812546:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317152.708184:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317152.836310:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317152.966521:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317152.966529:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317152.966532:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317152.966535:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317152.966541:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317152.966550:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2399 00000100:00080000:3.0:1767317152.966561:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317152.966613:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317152.966636:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317152.966672:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894170752/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317152.966851:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894170752:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317152.966887:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894171008:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317152.967136:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1767317152.967144:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894170880:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317152.967175:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894171136:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317152.981164:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894170880:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317152.981357:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317152.981364:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317152.981368:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894170752:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317152.984630:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894171008:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317152.986725:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894171136:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317153.732220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317153.861187:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317154.756202:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317154.890163:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317155.780170:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317155.909043:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317156.804983:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317156.932431:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317157.829813:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317157.956503:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317158.087770:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317158.087786:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317158.087790:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317158.087795:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317158.087801:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317158.087815:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2404 00000100:00080000:3.0:1767317158.087830:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317158.087841:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317158.087857:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317158.087915:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894171264/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317158.088069:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894171520:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317158.088237:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894171264:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317158.088240:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1767317158.088252:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894171392:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317158.088290:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894171648:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317158.094560:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1767317158.094572:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894171392:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317158.094578:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317158.094590:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894171264:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317158.095252:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894171648:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317158.095270:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894171520:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317158.852859:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317158.980543:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317159.877476:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317160.006016:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317160.900349:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317161.028447:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317161.924266:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317162.054568:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317162.948540:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317163.076928:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317163.204379:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317163.204393:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317163.204397:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317163.204402:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317163.204408:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317163.204422:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2409 00000100:00080000:3.0:1767317163.204437:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317163.204447:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317163.204462:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317163.204544:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894171776/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317163.204655:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894172032:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317163.204777:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1767317163.204786:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894171904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317163.204816:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894172160:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317163.204925:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894171776:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317163.214986:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894171904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317163.215009:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894172032:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317163.217167:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894172160:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317163.220207:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317163.220220:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317163.220224:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894171776:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317163.972236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317164.100984:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317164.998222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317165.125105:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317166.020165:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317166.148420:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317167.044260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317167.172346:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317168.068228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317168.196908:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317168.324359:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317168.324374:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317168.324378:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317168.324382:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317168.324386:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317168.324396:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2414 00000100:00080000:1.0:1767317168.324406:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317168.324412:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317168.324423:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317168.324467:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0a80 x1853163894172288/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317168.324544:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894172416:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317168.324770:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894172288:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317168.324861:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894172544:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317168.325131:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894172672:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317168.333196:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317168.333213:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317168.333219:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894172288:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317168.333407:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894172544:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317168.335236:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894172416:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317168.335252:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894172672:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317169.092214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317169.222123:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317170.116268:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317170.246845:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317171.141063:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317171.268414:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317172.164433:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317172.292460:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317172.421914:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317147/real 1767317147] req@ffff9cfe29108e00 x1853163894170112/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317172 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317172.421955:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29108e00 x1853163894170112/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317172 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317172.421975:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317172.422005:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767317172.422009:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894170112:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767317172.422204:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317172.422210:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317172.422213:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317172.422218:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2399 00000100:00080000:3.0:1767317172.422227:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317172.422234:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767317172.422273:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6680 x1853163894172800/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317172.422304:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317172.422308:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317172.422310:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317172.422314:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2419 00000100:00080000:3.0:1767317172.422318:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317172.422322:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317172.422331:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317172.422343:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894172928/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317172.422514:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894172800:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767317172.422609:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894172928:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317172.423192:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894173056:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317172.423252:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894173312:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317172.423278:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317172.423284:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894173184:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317172.431436:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894173184:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317172.431455:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894173312:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317172.439357:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317172.439371:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317172.439376:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894172928:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317172.439601:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894173056:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317173.188223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317173.318530:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317174.214756:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317174.340414:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317175.236433:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317175.366655:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317176.260159:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317176.388473:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317177.284201:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317177.412413:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317177.540517:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317177.540528:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317177.540531:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317177.540535:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317177.540556:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317177.540567:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2423 00000100:00080000:3.0:1767317177.540577:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317177.540584:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317177.540594:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317177.540625:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894173440/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317177.540693:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894173440:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317177.541121:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894173568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317177.541171:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894173824:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317177.541210:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317177.541216:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894173696:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317177.552482:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317177.552498:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317177.552505:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894173440:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317177.552848:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894173824:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317177.552868:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894173696:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317177.552878:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894173568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317178.310505:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317178.436593:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317179.332215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317179.460592:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317180.356811:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317180.484485:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317181.380949:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317181.511344:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317182.404895:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317182.532385:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317182.660356:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317182.660367:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317182.660371:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317182.660375:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317182.660380:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317182.660390:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2428 00000100:00080000:0.0:1767317182.660401:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317182.660409:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317182.660422:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317182.660474:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9c00 x1853163894173952/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317182.660531:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894174080:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317182.660560:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894173952:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317182.660654:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894174208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317182.660681:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317182.660686:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894174336:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317182.663994:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317182.664011:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317182.664016:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894173952:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317182.664136:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894174336:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317182.664151:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894174208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317182.674116:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894174080:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317183.428246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317183.558886:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317184.453329:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317184.581107:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317185.476157:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317185.615549:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317186.500230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317186.628277:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317187.524712:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317187.652824:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317187.781763:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317187.781774:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317187.781777:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317187.781781:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317187.781786:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317187.781814:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2434 00000100:00080000:3.0:1767317187.781826:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317187.781833:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317187.781846:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317187.781880:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894174464/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317187.781990:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894174592:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317187.782029:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894174464:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317187.782220:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894174720:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317187.787868:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894174848:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317187.798438:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894174720:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317187.798902:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317187.798909:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317187.798913:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894174464:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317187.802171:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894174848:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317187.802196:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894174592:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317188.549298:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317188.676298:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317189.573136:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317189.701997:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317190.597224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317190.724422:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317191.620258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317191.748370:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317192.644266:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317192.772391:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317192.900762:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317192.900775:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317192.900777:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317192.900782:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317192.900786:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317192.900796:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2439 00000100:00080000:3.0:1767317192.900807:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317192.900814:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317192.900843:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317192.900875:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894174976/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317192.900975:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894175232:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317192.901078:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1767317192.901308:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894174976:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317192.902008:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894175104:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317192.902051:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894175360:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317192.910520:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317192.910537:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317192.910559:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894174976:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317192.911717:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894175104:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317192.911733:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894175232:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317192.912557:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894175360:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317193.668581:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317193.797460:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317194.692840:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317194.823969:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317195.716234:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317195.844856:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317196.740171:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317196.868811:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317197.764204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317197.898822:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317198.020257:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1767317198.020263:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317172/real 1767317172] req@ffff9cfe18fd6680 x1853163894172800/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317197 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767317198.020265:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317198.020268:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317198.020272:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317198.020276:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317198.020283:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2444 00000100:00100000:0.0:1767317198.020295:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd6680 x1853163894172800/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317197 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767317198.020313:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317198.020315:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317198.020321:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317198.020333:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317198.020365:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894175488/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767317198.020418:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767317198.020423:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894172800:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767317198.020450:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894175488:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767317198.020454:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317198.020457:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317198.020459:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317198.020462:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2423 00000100:00080000:3.0:1767317198.020466:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317198.020469:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767317198.020479:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894176000/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317198.020502:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894175744:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317198.021461:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894175616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317198.021515:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894175872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317198.022112:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894176000:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317198.026508:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317198.026522:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317198.026528:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894175488:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317198.027507:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894175616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317198.027523:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894175872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317198.027871:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894175744:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317198.788229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317198.916391:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317199.812696:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317199.940330:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317200.837031:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317200.964348:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317201.860425:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317201.988796:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317202.884216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317203.017275:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317203.140261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317203.140292:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317203.140306:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317203.140310:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317203.140314:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317203.140324:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2449 00000100:00080000:3.0:1767317203.140336:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317203.140343:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317203.140354:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317203.140388:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4380 x1853163894176128/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317203.140492:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894176384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317203.140596:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1767317203.140602:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894176256:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317203.140631:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894176512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317203.141199:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894176128:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317203.147638:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894176256:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317203.150763:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317203.150778:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317203.150782:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894176128:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317203.156491:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894176384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317203.174040:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894176512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317203.908230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317204.036553:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317204.933516:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317205.060347:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317205.956260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317206.086430:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317206.980264:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317207.108370:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317208.004217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317208.133151:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317208.262269:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317208.262280:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317208.262299:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317208.262303:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317208.262308:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317208.262317:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2454 00000100:00080000:3.0:1767317208.262327:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317208.262334:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317208.262346:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317208.262376:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894176640/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317208.262519:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894176640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317208.262694:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894176768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317208.262730:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894177024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317208.262753:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317208.262758:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894176896:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317208.271645:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317208.271670:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317208.271676:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894176640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317208.274291:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894176896:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317208.274311:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894176768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317208.274323:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894177024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317209.028214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317209.156957:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317210.052304:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317210.180819:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317211.076278:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317211.204922:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317212.100261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317212.229232:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317213.125411:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317213.256156:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317213.381005:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317213.381014:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317213.381017:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317213.381020:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317213.381034:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317213.381044:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2459 00000100:00080000:0.0:1767317213.381058:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317213.381064:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317213.381076:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317213.381144:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9180 x1853163894177152/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317213.381239:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894177408:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317213.381346:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1767317213.381353:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894177280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317213.381399:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894177536:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317213.381618:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894177152:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767317213.384939:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317213.384955:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317213.384960:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894177152:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317213.385063:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894177280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317213.385075:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894177536:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317213.385124:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894177408:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317214.148196:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317214.276806:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317215.177162:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317215.301310:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317216.196187:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317216.325491:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317217.220295:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317217.348631:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317218.245325:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317218.372521:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317218.500655:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317218.500664:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317218.500666:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317218.500670:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317218.500674:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317218.500684:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2464 00000100:00080000:3.0:1767317218.500712:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317218.500720:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317218.500732:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317218.500761:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894177664/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317218.500842:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894177664:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317218.501188:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894177792:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317218.501224:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894178048:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317218.501339:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317218.501345:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894177920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317218.507637:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894177920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317218.507656:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894177792:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317218.507667:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894178048:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317218.507891:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317218.507898:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317218.507902:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894177664:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317219.268245:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317219.398501:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317220.292392:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317220.420503:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317221.316331:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317221.444351:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317222.340262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317222.468302:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317223.368029:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317223.492746:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317223.620352:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317223.620373:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317223.620377:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317223.620382:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317223.620389:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317223.620406:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2469 00000100:00080000:3.0:1767317223.620422:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317223.620470:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317223.620486:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317223.620535:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894178176/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317223.620649:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894178304:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317223.620779:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894178560:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317223.620823:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317223.620830:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894178432:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317223.625578:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317198/real 1767317198] req@ffff9cfe18fd5c00 x1853163894176000/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317223 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767317223.625622:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd5c00 x1853163894176000/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317223 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767317223.625648:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894178176:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767317223.625775:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317223.625802:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767317223.625808:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894176000:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767317223.625923:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317223.625944:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767317223.625956:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317223.625966:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2449 00000100:00080000:0.0:1767317223.625977:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317223.625985:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767317223.626030:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8700 x1853163894178688/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317223.626293:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894178688:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767317223.627851:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894178432:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317223.627875:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894178304:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317223.627890:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894178560:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317223.628966:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317223.628978:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317223.628982:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894178176:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317224.388297:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317224.516481:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317225.412330:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317225.540295:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317226.437140:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317226.564380:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317227.460247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317227.590333:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317228.484202:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317228.612420:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317228.740390:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317228.740400:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317228.740403:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317228.740407:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317228.740411:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317228.740421:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2474 00000100:00080000:3.0:1767317228.740431:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317228.740437:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317228.740448:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317228.740483:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894178816/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317228.740575:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894178944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317228.740683:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894179200:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317228.740709:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317228.740714:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894179072:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317228.741166:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894178816:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317228.744018:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894179072:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317228.744038:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894179200:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317228.754925:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317228.754939:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317228.754944:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894178816:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317228.755458:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894178944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317229.508382:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317229.636468:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317230.532597:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317230.660717:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317231.560628:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317231.685179:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317232.580219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317232.708625:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317233.604234:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317233.732334:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317233.860428:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317233.860437:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317233.860439:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317233.860442:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317233.860446:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317233.860454:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2480 00000100:00080000:2.0:1767317233.860463:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317233.860468:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317233.860478:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317233.860508:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894179328/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317233.860594:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894179584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317233.860678:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1767317233.860683:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894179456:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317233.860701:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894179712:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317233.860756:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894179328:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317233.868623:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317233.868639:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317233.868644:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894179328:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317233.868793:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894179456:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317233.868822:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894179712:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317233.868832:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894179584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317234.628638:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317234.756890:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317235.656295:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317235.780350:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317236.676211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317236.806930:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317237.700213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317237.833376:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317238.725616:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317238.852442:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317238.980235:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317238.980243:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317238.980247:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317238.980251:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317238.980255:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317238.980264:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2485 00000100:00080000:0.0:1767317238.980275:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317238.980281:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317238.980309:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317238.980338:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb100 x1853163894179840/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317238.980602:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894179968:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317238.980706:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894180224:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317238.980735:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317238.980740:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894180096:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317238.981234:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894179840:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317238.992487:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894180096:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317238.992507:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894179968:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317238.992517:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894180224:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317238.995338:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317238.995353:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317238.995358:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894179840:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317239.748369:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317239.876352:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317240.772380:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317240.900368:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317241.797420:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317241.924387:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317242.820409:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317242.949443:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317243.844572:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317243.977571:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317244.102700:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317244.102710:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317244.102712:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317244.102716:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317244.102721:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317244.102730:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2490 00000100:00080000:3.0:1767317244.102740:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317244.102746:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317244.102782:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317244.102813:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894180352/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317244.102899:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894180608:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317244.102999:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1767317244.103006:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894180480:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317244.103032:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894180736:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317244.103420:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894180352:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317244.107861:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894180480:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317244.114672:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317244.114690:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317244.114696:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894180352:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317244.122067:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894180736:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317244.122117:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894180608:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317244.868413:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317245.003910:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317245.892294:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317246.020876:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317246.917346:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317247.045835:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317247.940273:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317248.072480:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317248.196383:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317223/real 1767317223] req@ffff9cfe089f8700 x1853163894178688/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317248 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767317248.196432:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089f8700 x1853163894178688/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317248 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767317248.196450:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317248.196477:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767317248.196481:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894178688:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767317248.196581:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317248.196586:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767317248.196595:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317248.196600:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2474 00000100:00080000:0.0:1767317248.196609:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317248.196616:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767317248.196643:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb100 x1853163894180864/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767317248.196669:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317248.196672:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317248.196674:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317248.196677:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2495 00000100:00080000:0.0:1767317248.196681:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317248.196684:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317248.196693:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317248.196703:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb480 x1853163894180992/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317248.196827:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894181248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317248.196929:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1767317248.196936:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894181120:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317248.196967:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894181376:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317248.197207:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894180864:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767317248.197242:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894180992:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767317248.204335:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317248.204352:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317248.204357:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894180992:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317248.206593:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894181120:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317248.206611:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894181376:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317248.206624:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894181248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317248.964244:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317249.092430:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317249.988265:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317250.118325:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317251.012226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317251.140299:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317252.038036:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317252.168119:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317253.063112:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317253.188485:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317253.316262:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317253.316272:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317253.316275:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317253.316279:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317253.316284:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317253.316293:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2499 00000100:00080000:3.0:1767317253.316304:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317253.316312:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317253.316324:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317253.316354:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894181504/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317253.316540:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894181632:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317253.316632:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894181888:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317253.316697:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317253.316704:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894181760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317253.316798:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894181504:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317253.326582:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894181632:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317253.326601:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894181888:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317253.326627:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894181760:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317253.326739:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317253.326908:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317253.326913:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894181504:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317254.084336:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317254.213372:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317255.108572:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317255.236338:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317256.132278:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317256.261215:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317257.157320:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317257.285863:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317258.180231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317258.309069:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317258.446975:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317258.446986:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317258.446989:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317258.446993:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317258.446998:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317258.447008:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2504 00000100:00080000:0.0:1767317258.447018:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317258.447025:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317258.447035:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317258.447069:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9880 x1853163894182016/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317258.447189:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894182272:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317258.447326:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1767317258.447333:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894182144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317258.447365:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894182400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317258.450889:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894182016:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317258.462876:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894182144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317258.462895:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894182272:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317258.464150:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317258.464163:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317258.464169:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894182016:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317258.471773:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894182400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317259.204275:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317259.334322:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317260.228326:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317260.357150:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317261.252213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317261.380356:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317262.277562:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317262.408666:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317263.300150:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317263.431281:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317263.562991:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317263.563002:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317263.563005:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317263.563029:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317263.563032:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317263.563043:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2509 00000100:00080000:3.0:1767317263.563053:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317263.563061:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317263.563073:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317263.563131:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6d80 x1853163894182528/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317263.563263:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894182528:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317263.565581:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894182656:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317263.565666:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894182912:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317263.565698:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317263.565705:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894182784:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317263.583663:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317263.583687:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317263.583692:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894182528:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317263.584296:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894182784:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317263.584312:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894182656:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317263.584322:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894182912:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317264.324309:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317264.452362:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317265.348246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317265.476351:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317266.372207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317266.500921:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317267.396682:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317267.527854:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317268.420373:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317268.548279:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317268.677381:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317268.677392:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317268.677395:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317268.677398:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317268.677403:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317268.677414:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2514 00000100:00080000:1.0:1767317268.677424:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317268.677454:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317268.677466:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317268.677496:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3100 x1853163894183040/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317268.677607:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894183296:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317268.677723:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1767317268.677730:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894183168:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317268.677759:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894183424:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317268.679123:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894183040:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317268.685880:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317268.685895:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317268.685913:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894183040:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317268.690539:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894183168:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317268.690574:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894183424:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317268.690587:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894183296:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317269.444220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317269.573244:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317270.468670:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317270.599946:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317271.492219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317271.620358:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317272.516250:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317272.646873:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317273.540206:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317273.668463:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317273.796256:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317248/real 1767317248] req@ffff9cfe089fb100 x1853163894180864/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317273 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317273.796300:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fb100 x1853163894180864/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317273 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317273.796318:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317273.796342:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767317273.796346:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894180864:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317273.796736:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317273.796742:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317273.796745:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317273.796751:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2499 00000100:00080000:1.0:1767317273.796759:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317273.796766:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767317273.796796:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1500 x1853163894183552/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317273.796869:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894183552:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317273.797743:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317273.797749:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317273.797766:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317273.797772:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2520 00000100:00080000:1.0:1767317273.797779:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317273.797783:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317273.797793:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317273.797811:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2d80 x1853163894183680/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317273.801032:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894183680:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317273.807475:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894183936:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317273.807595:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1767317273.807602:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894183808:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317273.807629:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894184064:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317273.817409:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317273.817432:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317273.817438:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894183680:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317273.822267:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894183808:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317273.830740:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894184064:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317273.830759:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894183936:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317274.564849:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317274.692796:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317275.588781:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317275.716781:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317276.612424:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317276.740389:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317277.636432:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317277.765493:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317278.660609:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317278.788477:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317278.918095:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317278.918106:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317278.918109:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317278.918113:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317278.918118:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317278.918145:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2525 00000100:00080000:0.0:1767317278.918156:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317278.918162:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317278.918173:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317278.918206:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb100 x1853163894184192/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317278.918411:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894184320:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317278.918560:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894184576:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317278.918601:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317278.918609:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894184448:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317278.918725:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894184192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317278.922288:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894184320:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317278.939270:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317278.939286:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317278.939291:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894184192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317278.939389:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894184448:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317278.939418:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894184576:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317279.684254:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317279.812903:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317280.709144:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317280.839910:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317281.732406:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317281.860450:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317282.759192:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317282.886506:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317283.780222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317283.908691:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317284.037141:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317284.037151:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317284.037154:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317284.037158:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317284.037163:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317284.037173:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2530 00000100:00080000:0.0:1767317284.037183:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317284.037190:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317284.037201:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317284.037238:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8000 x1853163894184704/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317284.037448:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894184832:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317284.037606:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894184704:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317284.037616:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894185088:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317284.037658:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317284.037668:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894184960:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317284.047821:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894184960:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317284.047837:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894184832:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317284.047857:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894185088:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317284.047970:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317284.047976:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317284.047979:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894184704:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317284.807620:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317284.934182:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317285.833139:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317285.956306:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317286.852884:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317286.982134:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317287.876238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317288.005203:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317288.901825:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317289.029814:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317289.156490:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317289.156500:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317289.156503:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317289.156507:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317289.156512:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317289.156522:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2535 00000100:00080000:1.0:1767317289.156532:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317289.156539:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317289.156550:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317289.156583:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0700 x1853163894185216/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317289.156679:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894185472:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317289.156848:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1767317289.156855:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894185344:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317289.156882:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894185600:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317289.158522:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894185216:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767317289.161937:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317289.161951:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317289.161956:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894185216:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317289.162047:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894185344:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317289.162618:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894185600:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317289.162629:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894185472:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317289.924211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317290.052596:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317290.948243:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317291.077003:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317291.973119:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317292.100309:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317292.996236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317293.124345:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317294.020759:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317294.148818:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317294.276248:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317294.276259:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317294.276263:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317294.276266:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317294.276270:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317294.276280:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2540 00000100:00080000:1.0:1767317294.276291:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317294.276328:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317294.276340:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317294.276375:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0380 x1853163894185728/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317294.276498:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894185984:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317294.276591:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1767317294.276596:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894185856:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317294.276631:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894186112:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317294.276937:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894185728:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317294.279887:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894185984:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317294.281194:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894185856:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317294.281313:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317294.281323:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317294.281327:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894185728:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317294.282602:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894186112:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317295.044356:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317295.180758:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317296.068247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317296.196694:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317297.093425:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317297.221160:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317298.119186:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317298.244427:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317298.372241:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317273/real 1767317273] req@ffff9cfe0f3d1500 x1853163894183552/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317298 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317298.372289:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d1500 x1853163894183552/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317298 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317298.372310:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317298.372340:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767317298.372344:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894183552:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317298.372518:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317298.372523:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317298.372526:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317298.372532:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2525 00000100:00080000:1.0:1767317298.372541:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317298.372548:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767317298.372743:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3480 x1853163894186240/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317298.372804:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894186240:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317298.372913:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317298.372917:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317298.372919:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317298.372923:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2545 00000100:00080000:1.0:1767317298.372927:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317298.372932:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317298.372940:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317298.372953:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1c00 x1853163894186368/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317298.382497:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894186368:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317298.382792:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894186496:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317298.382828:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894186752:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317298.382853:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317298.382859:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894186624:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317298.396324:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317298.396340:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317298.396345:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894186368:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317298.396349:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894186624:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317298.396360:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894186496:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317298.396370:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894186752:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317299.140367:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317299.268434:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317300.164237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317300.293222:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317301.188231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317301.316633:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317302.212244:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317302.340599:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317303.236259:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317303.366404:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317303.493338:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317303.493353:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317303.493357:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317303.493360:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317303.493364:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317303.493394:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2549 00000100:00080000:3.0:1767317303.493405:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317303.493411:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317303.493422:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317303.493455:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894186880/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317303.494630:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894187008:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317303.494725:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894187264:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317303.494755:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317303.494760:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894187136:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317303.495892:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894186880:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317303.498745:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894187008:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317303.498767:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894187264:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317303.498794:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894187136:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317303.500430:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317303.500442:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317303.500459:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894186880:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317304.260386:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317304.388428:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317305.287430:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317305.412275:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317306.308329:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317306.437960:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317307.332228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317307.462928:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317308.359991:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317308.485897:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317308.612232:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317308.612244:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317308.612248:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317308.612253:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317308.612257:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317308.612279:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2554 00000100:00080000:3.0:1767317308.612291:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317308.612300:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317308.612330:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317308.612364:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894187392/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317308.612458:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894187520:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317308.612555:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894187776:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317308.612714:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894187648:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317308.614704:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894187392:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317308.615048:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894187776:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317308.623883:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894187648:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317308.624884:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894187520:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317308.631986:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317308.632003:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317308.632008:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894187392:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317309.380442:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317309.518669:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317310.404215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317310.532748:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317311.428333:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317311.556376:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317312.452388:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317312.581109:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317313.476615:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317313.605066:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317313.732204:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317313.732215:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317313.732219:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317313.732223:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317313.732228:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317313.732238:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2559 00000100:00080000:3.0:1767317313.732249:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317313.732257:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317313.732267:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317313.732304:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894187904/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317313.732375:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894187904:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317313.735167:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894188032:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317313.736996:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317313.737036:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894188160:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317313.739514:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894188288:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317313.740367:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317313.740375:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317313.740379:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894187904:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317313.741179:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894188032:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317313.754735:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894188288:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317313.754758:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894188160:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317314.500190:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317314.628502:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317315.524251:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317315.653399:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317316.551880:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317316.676785:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317317.572494:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317317.700351:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317318.598832:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317318.724579:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317318.852814:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317318.852825:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317318.852845:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317318.852848:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317318.852852:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317318.852862:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2565 00000100:00080000:3.0:1767317318.852874:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317318.852881:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317318.852892:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317318.852935:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894188416/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317318.853010:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894188544:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317318.853159:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894188800:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317318.853192:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317318.853198:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894188672:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317318.853539:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894188416:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317318.858660:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317318.858676:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317318.858682:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894188416:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317318.865040:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894188800:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317318.865112:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894188672:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317318.865127:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894188544:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317319.620405:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317319.748347:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317320.644215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317320.772556:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317321.668374:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317321.797172:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317322.692369:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317322.820393:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317323.717001:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317323.845013:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317323.972249:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317298/real 1767317298] req@ffff9cfe0f3d3480 x1853163894186240/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317323 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317323.972288:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d3480 x1853163894186240/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317323 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317323.972310:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317323.972340:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767317323.972345:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894186240:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767317323.972452:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317323.972458:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767317323.972461:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317323.972466:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2549 00000100:00080000:2.0:1767317323.972476:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317323.972482:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767317323.972515:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910a680 x1853163894188928/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767317323.972544:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317323.972548:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317323.972550:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317323.972554:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2570 00000100:00080000:2.0:1767317323.972558:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317323.972576:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317323.972586:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317323.972598:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894189056/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317323.972669:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894189312:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317323.972763:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1767317323.972771:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894189184:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317323.972798:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894189440:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317323.973022:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894188928:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767317323.973068:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894189056:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317323.977507:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317323.977525:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317323.977531:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894189056:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317323.979131:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894189184:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317323.979148:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894189440:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317323.979323:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894189312:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317324.740239:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317324.868435:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317325.764612:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317325.892381:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317326.788224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317326.916542:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317327.812242:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317327.940606:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317328.836399:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317328.965937:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317329.092860:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317329.092871:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317329.092874:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317329.092878:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317329.092883:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317329.092892:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2575 00000100:00080000:3.0:1767317329.092903:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317329.092910:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317329.092938:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317329.092971:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894189568/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317329.093131:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894189568:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317329.093140:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894189824:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317329.093505:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894189696:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317329.099920:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894189952:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317329.120328:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317329.120345:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317329.120352:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894189568:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317329.120388:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894189824:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317329.122126:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894189696:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317329.131338:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894189952:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317329.860232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317329.988465:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317330.884216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317331.012342:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317331.908263:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317332.040144:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317332.932185:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317333.060401:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317333.957266:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317334.087962:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317334.214249:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317334.214260:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317334.214263:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317334.214267:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317334.214272:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317334.214284:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2580 00000100:00080000:1.0:1767317334.214298:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317334.214305:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317334.214326:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317334.214363:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3480 x1853163894190080/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317334.214449:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894190208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317334.214483:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894190080:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317334.214564:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894190464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317334.214599:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317334.214608:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894190336:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317334.225137:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894190336:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317334.225177:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894190464:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317334.225654:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317334.225661:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317334.225665:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894190080:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317334.225759:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894190208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317334.980323:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317335.108439:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317336.004232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317336.134824:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317337.028413:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317337.159279:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317338.054007:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317338.183572:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317339.076942:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317339.204486:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317339.334458:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317339.334472:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317339.334475:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317339.334479:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317339.334483:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317339.334492:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2585 00000100:00080000:3.0:1767317339.334503:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317339.334510:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317339.334520:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317339.334551:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894190592/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317339.334794:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894190848:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317339.334797:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894190592:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317339.334883:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894190720:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317339.347536:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894190976:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317339.353951:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894190848:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317339.358295:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894190720:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317339.358482:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894190976:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317339.361535:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317339.361554:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317339.361561:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894190592:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317340.100238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317340.228426:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317341.124214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317341.255374:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317342.148369:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317342.276450:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317343.176906:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317343.300313:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317344.196232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317344.324517:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317344.456140:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317344.456154:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317344.456158:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317344.456163:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317344.456168:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317344.456181:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2590 00000100:00080000:0.0:1767317344.456193:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317344.456202:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317344.456215:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317344.456257:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb800 x1853163894191104/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317344.456359:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894191232:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317344.456489:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894191488:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317344.456532:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317344.456547:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894191360:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317344.456841:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894191104:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317344.459626:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894191488:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317344.467540:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894191360:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317344.467656:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317344.467678:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317344.467682:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894191104:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317344.480221:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894191232:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317345.220213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317345.348390:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317346.244245:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317346.373113:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317347.268853:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317347.396348:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317348.292216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317348.422076:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317348.548261:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317323/real 1767317323] req@ffff9cfe2910a680 x1853163894188928/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317348 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317348.548656:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe2910a680 x1853163894188928/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317348 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317348.548680:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317348.548719:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767317348.548724:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894188928:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767317348.548907:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317348.548913:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317348.548916:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317348.548940:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2575 00000100:00080000:3.0:1767317348.548951:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317348.548958:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767317348.548987:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894191616/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317348.549012:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317348.549016:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317348.549017:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317348.549021:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2595 00000100:00080000:3.0:1767317348.549024:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317348.549028:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317348.549036:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317348.549046:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894191744/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317348.549337:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894191872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317348.549457:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894192128:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317348.549500:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317348.549507:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894192000:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317348.550654:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894191616:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767317348.550740:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894191744:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317348.556881:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894191872:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317348.556989:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317348.556997:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317348.557001:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894191744:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317348.565492:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894192000:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317348.565510:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894192128:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317349.316238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317349.448849:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317350.340975:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317350.469194:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317351.364267:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317351.492360:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317352.388259:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317352.516616:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317353.412274:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317353.540988:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317353.669335:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317353.669348:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317353.669352:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317353.669357:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317353.669362:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317353.669375:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2599 00000100:00080000:2.0:1767317353.669389:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317353.669398:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317353.669412:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317353.669467:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894192256/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317353.669580:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894192384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317353.669691:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894192640:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317353.669729:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317353.669735:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894192512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317353.670042:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894192256:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317353.676496:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894192512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317353.676527:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894192384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317353.676541:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894192640:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317353.676734:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317353.676740:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317353.676744:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894192256:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317354.436373:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317354.564434:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317355.463719:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317355.588800:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317356.484401:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317356.613574:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317357.508263:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317357.637042:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317358.532285:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317358.662988:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317358.788705:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317358.788730:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317358.788734:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317358.788739:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317358.788744:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317358.788759:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2605 00000100:00080000:0.0:1767317358.788772:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317358.788782:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317358.788797:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317358.788844:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9880 x1853163894192768/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317358.788954:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894193024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317358.788962:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894192896:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317358.789382:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894192768:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317358.792536:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894193152:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317358.796700:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894193024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317358.803611:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894192896:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317358.822456:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894193152:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317358.826909:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317358.826925:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317358.826931:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894192768:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317359.556780:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317359.684461:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317360.580249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317360.716131:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317361.604215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317361.732475:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317362.629123:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317362.756455:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317363.652225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317363.780928:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317363.908326:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317363.908337:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317363.908340:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317363.908344:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317363.908348:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317363.908358:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2610 00000100:00080000:2.0:1767317363.908372:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317363.908379:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317363.908390:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317363.908430:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894193280/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317363.908514:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894193408:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317363.908609:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894193664:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317363.908644:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317363.908680:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894193536:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317363.908926:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894193280:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317363.916197:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894193536:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317363.916217:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894193664:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317363.937657:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894193408:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317363.942062:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317363.942077:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317363.942107:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894193280:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317364.676213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317364.806007:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317365.703734:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317365.828332:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317366.724208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317366.852409:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317367.748238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317367.876312:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317368.773826:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317368.902616:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317369.030042:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317369.030052:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317369.030055:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317369.030058:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317369.030063:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317369.030072:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2615 00000100:00080000:3.0:1767317369.030120:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317369.030127:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317369.030139:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317369.030172:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6d80 x1853163894193792/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317369.030281:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894194048:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317369.030296:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894193920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317369.030431:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894193792:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317369.040756:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894194176:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317369.066451:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894194048:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317369.067408:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894193920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317369.067424:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894194176:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317369.068669:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317369.068679:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317369.068682:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894193792:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317369.796229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317369.924496:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317370.821618:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317370.948413:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317371.844218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317371.981369:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317372.868369:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317372.997372:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317373.188269:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317348/real 1767317348] req@ffff9cfe18fd5880 x1853163894191616/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317373 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317373.188316:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd5880 x1853163894191616/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317373 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317373.188343:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317373.188374:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767317373.188379:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894191616:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767317373.188470:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317373.188482:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767317373.188485:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317373.188496:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2599 00000100:00080000:0.0:1767317373.188525:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317373.188533:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767317373.188716:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8700 x1853163894194304/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767317373.188750:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317373.188754:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317373.188755:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317373.188759:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2620 00000100:00080000:0.0:1767317373.188763:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317373.188768:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317373.188777:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317373.188789:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa300 x1853163894194432/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317373.188857:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894194560:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317373.188976:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894194816:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317373.189012:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317373.189018:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894194688:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317373.189637:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894194304:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767317373.189727:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894194432:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317373.193173:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317373.193194:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317373.193200:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894194432:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317373.196674:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894194688:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317373.196693:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894194560:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317373.196704:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894194816:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317373.892715:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317374.022177:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317374.918230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317375.045452:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317375.940275:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317376.069794:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317376.965154:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317377.092330:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317377.988295:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317378.117646:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317378.244468:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317378.244483:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317378.244486:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317378.244490:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317378.244497:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317378.244510:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2624 00000100:00080000:0.0:1767317378.244525:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317378.244534:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317378.244577:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317378.244626:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894194944/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317378.244734:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894195200:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317378.244962:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1767317378.244970:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894195072:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317378.245014:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894195328:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317378.245835:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894194944:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317378.250529:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894195328:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317378.250589:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894195200:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317378.251262:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894195072:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317378.252106:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317378.252115:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317378.252120:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894194944:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317379.012691:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317379.140395:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317380.036593:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317380.167375:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317381.060437:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317381.190013:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317382.084932:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317382.213229:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317383.108946:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317383.236556:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317383.369280:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317383.369296:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317383.369299:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317383.369304:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317383.369310:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317383.369324:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2629 00000100:00080000:2.0:1767317383.369340:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317383.369348:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317383.369363:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317383.369413:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894195456/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317383.369522:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894195584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317383.369675:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894195840:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317383.369881:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894195456:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317383.369973:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894195712:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317383.386212:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894195840:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317383.386667:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894195712:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317383.390026:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317383.390047:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317383.390054:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894195456:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317383.390583:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894195584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317384.136299:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317384.260451:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317385.156259:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317385.285696:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317386.180254:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317386.308394:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317387.205393:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317387.332383:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317388.231931:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317388.356540:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317388.484818:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317388.484842:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317388.484846:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317388.484850:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317388.484856:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317388.484870:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2634 00000100:00080000:3.0:1767317388.484885:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317388.484895:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317388.484912:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317388.484960:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894195968/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317388.485157:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894196224:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317388.485297:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1767317388.485304:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894196096:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317388.485332:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894196352:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317388.485601:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894195968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317388.492129:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894196352:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317388.492157:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894196224:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317388.492767:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894196096:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317388.496193:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317388.496225:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317388.496232:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894195968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317389.252298:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317389.387002:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317390.278651:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317390.405647:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317391.300281:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317391.433144:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317392.324406:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317392.452301:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317393.348277:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317393.476434:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317393.604860:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317393.604873:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317393.604876:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317393.604881:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317393.604886:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317393.604899:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2639 00000100:00080000:0.0:1767317393.604911:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317393.604919:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317393.604933:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317393.604972:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9c00 x1853163894196480/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317393.605147:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894196608:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317393.605431:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894196864:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317393.605465:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317393.605471:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894196736:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317393.606130:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894196480:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317393.608145:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894196736:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317393.608176:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894196864:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317393.621515:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317393.621544:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317393.621549:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894196480:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317393.623436:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894196608:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317394.380839:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317394.500448:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317395.399881:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317395.524519:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317396.420203:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317396.548407:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317397.444228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317397.574941:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317398.468795:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317398.596476:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317398.724496:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317373/real 1767317373] req@ffff9cfe089f8700 x1853163894194304/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317398 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767317398.724532:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089f8700 x1853163894194304/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317398 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767317398.724554:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317398.724567:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767317398.724572:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894194304:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767317398.724585:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317398.724592:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767317398.724596:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317398.724602:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2624 00000100:00080000:0.0:1767317398.724612:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317398.724619:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767317398.724662:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9f80 x1853163894196992/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767317398.724707:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317398.724712:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317398.724713:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317398.724718:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2644 00000100:00080000:0.0:1767317398.724723:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317398.724735:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317398.724744:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317398.724758:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8380 x1853163894197120/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317398.724874:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894197248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317398.724970:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894197504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317398.724995:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317398.725001:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894197376:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317398.725050:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894196992:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767317398.725110:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894197120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317398.732898:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894197376:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317398.732917:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317398.732928:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317398.732933:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894197120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317398.732943:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894197248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317398.732960:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894197504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317399.492261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317399.621301:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317400.516213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317400.645226:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317401.540258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317401.668317:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317402.564260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317402.695305:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317403.588253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317403.716276:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317403.846269:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317403.846275:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317403.846277:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317403.846280:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317403.846283:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317403.846291:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2650 00000100:00080000:2.0:1767317403.846300:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317403.846305:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317403.846325:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317403.846365:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894197632/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317403.846753:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894197632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317403.847045:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894197760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317403.847128:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894198016:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317403.847156:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317403.847162:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894197888:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317403.848882:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894197888:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317403.848900:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894198016:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317403.850613:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317403.850625:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317403.850630:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894197632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317403.850800:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894197760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317404.612196:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317404.742621:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317405.640579:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317405.764684:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317406.660309:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317406.790317:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317407.684296:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317407.812357:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317408.712661:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317408.836634:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317408.964343:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317408.964353:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317408.964356:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317408.964360:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317408.964364:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317408.964374:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2655 00000100:00080000:0.0:1767317408.964402:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317408.964410:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317408.964420:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317408.964462:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9c00 x1853163894198144/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317408.964543:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894198272:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317408.964652:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894198528:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317408.964695:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317408.964701:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894198400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317408.965059:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894198144:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317408.967861:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894198272:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317408.967878:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894198528:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317408.968657:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317408.968666:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317408.968671:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894198144:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317408.971776:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894198400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317409.732290:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317409.861297:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317410.756312:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317410.884920:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317411.780233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317411.908595:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317412.804733:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317412.932443:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317413.830589:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317413.958331:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317414.084205:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317414.084225:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317414.084228:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317414.084232:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317414.084237:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317414.084248:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2660 00000100:00080000:0.0:1767317414.084286:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317414.084294:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317414.084305:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317414.084334:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089faa00 x1853163894198656/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317414.084403:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894198656:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317414.084433:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894198912:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317414.084521:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894198784:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317414.095428:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894199040:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317414.099125:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894198912:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317414.100571:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317414.100584:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317414.100588:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894198656:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317414.119392:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894199040:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317414.119431:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894198784:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317414.852207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317414.985122:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317415.876270:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317416.004597:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317416.900455:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317417.028499:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317417.924399:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317418.053336:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317418.948964:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317419.076335:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317419.204418:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317419.204428:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317419.204431:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317419.204452:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317419.205377:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317419.205392:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2665 00000100:00080000:1.0:1767317419.205404:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317419.205412:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317419.205423:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317419.205454:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2680 x1853163894199168/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317419.205558:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894199424:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317419.205736:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1767317419.205743:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894199296:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317419.205770:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894199552:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317419.210217:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894199168:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317419.218889:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317419.218906:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317419.218911:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894199168:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317419.219423:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894199296:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317419.221529:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894199552:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317419.221547:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894199424:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317419.972222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317420.100448:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317420.996222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317421.126985:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317422.023834:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317422.148625:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317423.046503:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317423.172481:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317423.301071:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317398/real 1767317398] req@ffff9cfe089f9f80 x1853163894196992/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317423 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767317423.301147:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089f9f80 x1853163894196992/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317423 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767317423.301167:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317423.301495:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767317423.301502:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894196992:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767317423.302996:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317423.303003:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767317423.303007:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317423.303029:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2650 00000100:00080000:2.0:1767317423.303039:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317423.303045:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767317423.303095:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894199680/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317423.303182:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894199680:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767317423.303284:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317423.303288:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317423.303290:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317423.303295:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2670 00000100:00080000:2.0:1767317423.303298:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317423.304349:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317423.304360:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317423.304383:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894199808/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317423.307074:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894199808:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317423.309819:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894200064:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317423.309912:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1767317423.309919:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894199936:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317423.309945:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894200192:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317423.315009:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317423.315025:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317423.315031:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894199808:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317423.315476:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894199936:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317423.315490:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894200192:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317423.315512:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894200064:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317424.068256:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317424.196945:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317425.092222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317425.220593:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317426.116776:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317426.244586:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317427.141662:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317427.270022:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317428.164735:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317428.292921:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317428.420504:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317428.420515:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317428.420518:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317428.420543:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317428.420548:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317428.420559:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2674 00000100:00080000:0.0:1767317428.420570:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317428.420578:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317428.420590:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317428.420915:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089faa00 x1853163894200320/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317428.420980:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894200320:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317428.421431:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894200576:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317428.421484:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1767317428.421491:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894200448:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317428.421516:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894200704:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317428.429432:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894200576:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317428.442865:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317428.442881:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317428.442887:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894200320:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317428.443385:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894200448:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317428.443400:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894200704:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317429.188215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317429.316577:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317430.212217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317430.342331:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317431.237225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317431.364378:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317432.261015:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317432.388406:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317433.284206:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317433.414452:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317433.540538:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317433.540549:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317433.540552:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317433.540556:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317433.540560:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317433.540570:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2679 00000100:00080000:3.0:1767317433.540581:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317433.540588:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317433.540599:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317433.540636:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894200832/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317433.540831:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894200832:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317433.541071:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894200960:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317433.541139:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894201216:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317433.541182:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317433.541188:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894201088:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317433.544159:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317433.544175:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317433.544180:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894200832:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317433.544781:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894201088:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317433.544795:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894200960:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317433.544825:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894201216:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317434.308453:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317434.437975:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317435.333669:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317435.460341:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317436.356279:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317436.484418:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317437.380175:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317437.510462:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317438.405951:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317438.533008:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317438.660277:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317438.660292:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317438.660296:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317438.660300:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317438.660306:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317438.660319:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2684 00000100:00080000:3.0:1767317438.660334:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317438.660342:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317438.660357:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317438.660405:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7100 x1853163894201344/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317438.660525:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894201600:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317438.660658:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1767317438.660666:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894201472:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317438.660698:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894201728:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317438.662133:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894201344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317438.665676:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894201472:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317438.665703:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894201728:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317438.665758:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317438.665767:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317438.665772:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894201344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317438.665918:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894201600:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317439.428215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317439.556520:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317440.452276:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317440.580744:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317441.476262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317441.604556:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317442.500204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317442.628356:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317443.524214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317443.652368:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317443.780410:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317443.780421:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317443.780424:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317443.780428:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317443.780433:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317443.780444:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2690 00000100:00080000:2.0:1767317443.780456:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1767317443.780463:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317443.780473:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317443.780508:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910a680 x1853163894201856/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317443.780600:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894202112:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317443.780715:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1767317443.780722:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894201984:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317443.780766:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894202240:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317443.781255:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894201856:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317443.789482:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894202240:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317443.789503:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894202112:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317443.790907:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317443.790920:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317443.790924:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894201856:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317443.791129:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894201984:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317444.548986:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317444.679290:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317445.572209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317445.703876:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317446.596495:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317446.725344:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317447.620197:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317447.748634:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317448.644183:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317448.772562:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317448.900234:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317423/real 1767317423] req@ffff9cfe29108a80 x1853163894199680/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317448 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317448.900269:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29108a80 x1853163894199680/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317448 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317448.900289:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317448.900323:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767317448.900328:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894199680:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767317448.900391:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317448.900398:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317448.900401:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317448.900407:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2674 00000100:00080000:3.0:1767317448.900417:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317448.900424:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767317448.900454:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894202368/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317448.900483:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317448.900487:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317448.900489:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317448.900547:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2695 00000100:00080000:3.0:1767317448.900562:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1767317448.900567:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317448.900577:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317448.900591:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894202496/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317448.900685:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894202752:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317448.900928:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1767317448.900936:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894202624:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317448.900976:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894202880:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317448.901477:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894202368:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767317448.901530:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894202496:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317448.909622:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894202880:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317448.909647:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894202752:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317448.911640:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894202624:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317448.916807:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317448.916822:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317448.916828:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894202496:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317449.668226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317449.796515:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317450.692928:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317450.820436:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317451.716291:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317451.845226:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317452.742222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317452.873377:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317453.765813:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317453.892643:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317454.021231:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317454.021253:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317454.021256:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317454.021260:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317454.021264:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317454.021274:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2700 00000100:00080000:3.0:1767317454.021287:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1767317454.021295:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317454.021307:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317454.021346:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7100 x1853163894203008/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317454.021439:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894203264:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317454.021571:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1767317454.021578:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894203136:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317454.021604:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894203392:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317454.021895:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894203008:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317454.029946:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894203264:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317454.032555:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894203392:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317454.042098:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894203136:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317454.042197:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317454.042205:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317454.042209:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894203008:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317454.788824:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317454.916503:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317455.813828:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317455.940532:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317456.836295:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317456.964426:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317457.860179:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317457.993115:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317458.884211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317459.014642:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317459.142902:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317459.142913:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317459.142916:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317459.142920:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317459.142925:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317459.142935:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2705 00000100:00080000:1.0:1767317459.142946:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317459.142953:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317459.142965:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317459.143011:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1880 x1853163894203520/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317459.143156:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894203776:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317459.143258:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1767317459.143266:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894203648:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317459.143294:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894203904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317459.143386:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894203520:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317459.150072:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894203904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317459.158283:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894203648:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317459.158327:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1767317459.158328:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894203776:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317459.158340:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317459.158347:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894203520:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317459.908615:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317460.036342:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317460.932200:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317461.060347:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317461.960110:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317462.084468:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317462.984713:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317463.109722:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317464.004195:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317464.134762:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317464.260277:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317464.260285:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317464.260288:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317464.260292:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317464.260297:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317464.260307:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2710 00000100:00080000:1.0:1767317464.260318:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317464.260325:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317464.260336:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317464.260387:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0e00 x1853163894204032/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317464.260473:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894204032:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317464.260590:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894204160:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317464.272136:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894204416:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317464.272216:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894204288:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317464.279483:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317464.279503:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317464.279508:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894204032:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317464.286739:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894204160:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317464.286757:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894204416:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317464.287011:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894204288:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317465.028206:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317465.157901:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317466.056346:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317466.180538:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317467.076720:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767317467.206151:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317468.100411:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317468.228377:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317469.125368:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317469.252863:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317469.381098:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317469.381108:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317469.381112:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317469.381115:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317469.381120:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317469.381131:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2715 00000100:00080000:3.0:1767317469.381142:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317469.381149:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317469.381160:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317469.381192:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894204544/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317469.381279:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894204800:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317469.381892:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1767317469.381902:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894204672:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317469.381931:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894204928:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317469.383135:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894204544:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317469.395396:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894204672:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317469.395423:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894204928:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317469.395437:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894204800:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317469.400458:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317469.400527:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317469.400533:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894204544:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317470.150834:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317470.279047:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317471.172216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317471.301401:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317472.196213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317472.326484:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317473.220246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317473.348491:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317473.476525:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317448/real 1767317448] req@ffff9cfe18fd7800 x1853163894202368/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317473 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767317473.476585:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd7800 x1853163894202368/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317473 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767317473.476604:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317473.476628:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767317473.476632:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894202368:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317473.476789:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317473.476795:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317473.476798:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317473.476804:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2700 00000100:00080000:1.0:1767317473.476813:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317473.476819:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767317473.476852:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2680 x1853163894205056/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767317473.476889:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317473.476893:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317473.476895:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317473.476900:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2720 00000100:00080000:1.0:1767317473.476904:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317473.476908:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317473.476918:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317473.476932:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1c00 x1853163894205184/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317473.477129:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894205440:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317473.477225:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1767317473.477232:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894205312:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317473.477255:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894205568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317473.477632:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894205056:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767317473.477699:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894205184:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317473.485387:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317473.485403:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317473.485409:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894205184:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317473.485519:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894205312:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317473.485531:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894205440:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317473.504257:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894205568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317474.244326:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317474.372661:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317475.268263:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317475.396513:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317476.292216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317476.421897:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317477.317830:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317477.444678:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317478.340237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317478.468681:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317478.596872:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317478.596883:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317478.596886:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317478.596890:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317478.596894:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317478.596906:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2724 00000100:00080000:3.0:1767317478.596918:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317478.596927:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317478.596941:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317478.596976:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894205696/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317478.597136:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894205952:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317478.597245:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1767317478.597252:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894205824:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317478.597281:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894206080:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317478.597805:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894205696:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317478.600728:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894205824:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317478.605758:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894206080:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317478.605778:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894205952:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317478.606004:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317478.606011:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317478.606015:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894205696:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317479.364271:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317479.494534:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317480.388286:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317480.517431:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317481.412598:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317481.540538:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317482.436232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317482.564623:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317483.460222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317483.588929:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317483.716255:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317483.716265:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317483.716269:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317483.716273:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317483.716277:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317483.716287:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2729 00000100:00080000:3.0:1767317483.716313:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317483.716321:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317483.716331:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317483.716362:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894206208/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317483.716499:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894206336:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317483.716505:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894206208:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317483.723709:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894206592:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317483.723803:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317483.723810:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894206464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317483.726668:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894206336:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317483.730660:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894206464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317483.730679:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894206592:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317483.740855:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317483.740872:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317483.740877:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894206208:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317484.484595:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317484.613420:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317485.508221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317485.636352:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317486.532178:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317486.660357:0:52122:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 6/6 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1767317486.660689:0:63296:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 6 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1767317486.660700:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad573a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae7c4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660726:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5738c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae777 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660736:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57369 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae6e4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660744:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660766:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5732a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae5a9 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660774:0:63296:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aef lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac4a1 expref: -99 pid: 82414 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660822:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad573a1 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae7c4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660831:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5738c lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae777 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660837:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57369 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae6e4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660843:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660849:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5732a lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae5a9 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660855:0:63296:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aef lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac4a1 expref: -99 pid: 82414 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660861:0:63296:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 6 locks packed 00010000:00010000:2.0:1767317486.660897:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037dc00/0xd9a0da65fad573a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae7c4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660932:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037de00/0xd9a0da65fad5738c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae777 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660943:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037c000/0xd9a0da65fad57369 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae6e4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660952:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2c200/0xd9a0da65fad569bb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac0db expref: -99 pid: 81824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660963:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d800/0xd9a0da65fad5732a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae5a9 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660972:0:63296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9cfe08c17800 lock: ffff9cfe1037d600/0xd9a0da65fad56aef lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac4a1 expref: -99 pid: 82414 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767317486.660984:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317486.660986:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767317486.660988:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317486.660997:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317486.661016:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894206720:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767317486.661145:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317486.670722:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894206720:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317487.557812:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317487.684416:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317488.580290:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317488.711420:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317488.836227:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317488.836238:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317488.836241:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317488.836245:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317488.836250:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317488.836259:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2735 00000100:00080000:3.0:1767317488.836269:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317488.836276:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317488.836287:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317488.836340:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894206848/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317488.836461:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894207104:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317488.836594:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1767317488.836601:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894206976:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317488.836628:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894207232:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317488.838695:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894206848:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317488.839047:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894206976:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317488.842674:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894207104:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317488.843785:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317488.843795:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317488.843800:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894206848:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317488.844886:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894207232:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317489.604239:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317489.734674:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317490.630421:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317490.758814:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317491.652226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317491.781212:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317492.679650:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317492.806393:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317493.700242:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317493.831004:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317493.956201:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317493.956211:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317493.956214:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317493.956217:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317493.956221:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317493.956231:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2740 00000100:00080000:3.0:1767317493.956240:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317493.956246:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317493.956257:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317493.956291:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894207360/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317493.956375:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894207616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317493.956494:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1767317493.956563:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894207488:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317493.956591:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894207744:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317493.956877:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894207360:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317493.960173:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894207488:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317493.960298:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317493.960306:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317493.960310:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894207360:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317493.964278:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894207744:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317493.964298:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894207616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317494.724223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317494.852394:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317495.748247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317495.876665:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317496.772333:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:1.0:1767317496.900281:0:52122:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 5/5 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1767317496.900771:0:59093:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 5 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767317496.900781:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae937 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317496.900811:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae8a4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317496.900821:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad573b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ae811 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317496.900830:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03718000/0xd9a0da65fad56792 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655aba2f expref: -99 pid: 79733 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317496.900839:0:59093:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c85 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x28400000000 nid: local remote: 0x863eb2f6655ac994 expref: -99 pid: 83008 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317496.900881:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573fc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae937 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317496.900889:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573d9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae8a4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317496.900895:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad573b6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae811 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317496.900902:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03718000/0xd9a0da65fad56792 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655aba2f expref: -99 pid: 79733 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317496.900931:0:59093:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c85 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac994 expref: -99 pid: 83008 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317496.900938:0:59093:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 5 locks packed 00010000:00010000:0.0:1767317496.900976:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2d200/0xd9a0da65fad573fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae937 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317496.901002:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095200/0xd9a0da65fad573d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae8a4 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317496.901015:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03c2dc00/0xd9a0da65fad573b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ae811 expref: -99 pid: 83725 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317496.901026:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe03718000/0xd9a0da65fad56792 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655aba2f expref: -99 pid: 79733 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317496.901037:0:59093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9cfe08c17800 lock: ffff9cfe05095400/0xd9a0da65fad56c85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x863eb2f6655ac994 expref: -99 pid: 83008 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767317496.901050:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317496.901052:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767317496.901054:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317496.901063:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767317496.901194:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894207872:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1767317496.901636:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317496.912069:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894207872:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767317497.798545:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317497.924651:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317498.052458:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317473/real 1767317473] req@ffff9cfe0f3d2680 x1853163894205056/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317498 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317498.052551:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d2680 x1853163894205056/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317498 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317498.052572:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317498.052603:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767317498.052607:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894205056:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767317498.053218:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317498.053224:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317498.053228:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317498.053233:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2724 00000100:00080000:3.0:1767317498.053243:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317498.053260:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767317498.053295:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894208000/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317498.053322:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317498.053327:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317498.053328:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317498.053333:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2745 00000100:00080000:3.0:1767317498.053337:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317498.053341:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317498.053351:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317498.053364:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4380 x1853163894208128/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317498.053445:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894208384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317498.053563:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1767317498.053572:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894208256:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317498.053616:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894208512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317498.053670:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894208000:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767317498.055385:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894208128:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317498.061700:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894208256:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317498.076437:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894208384:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317498.077053:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317498.077061:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317498.077066:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894208128:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317498.077424:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894208512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317498.820793:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317498.956159:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317499.845654:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317499.973858:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317500.868344:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317500.996320:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317501.894309:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317502.020478:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317502.916192:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317503.044586:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317503.172212:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317503.172223:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317503.172226:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317503.172230:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317503.172235:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317503.172247:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2749 00000100:00080000:3.0:1767317503.172270:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317503.172277:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317503.172289:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317503.172327:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894208640/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317503.172529:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894208768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317503.172653:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894209024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317503.172690:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317503.172696:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894208896:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317503.173425:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894208640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317503.175990:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894208768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317503.182956:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894208896:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317503.182972:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894209024:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317503.184644:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317503.184658:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317503.184664:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894208640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317503.941991:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317504.070269:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317504.964207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317505.092588:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317505.989944:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317506.116347:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317507.012227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317507.143631:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317508.036222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317508.164255:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317508.292209:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317508.292220:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317508.292223:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317508.292226:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317508.292231:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317508.292250:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2754 00000100:00080000:3.0:1767317508.292268:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317508.292275:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317508.292288:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317508.292324:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894209152/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317508.292394:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe068ea000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1767317508.292398:0:81663:0:(import.c:2080:ptlrpc_disconnect_and_idle_import()) lustre-OST0000-osc-ffff9cfe08c17800: disconnect after 22s idle 00000100:00100000:2.0:1767317508.292426:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894209280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317508.292430:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894209536:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317508.292502:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894209152:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317508.294939:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894209408:192.168.202.121@tcp:9:kworker.0 00000100:00100000:3.0:1767317508.298651:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894209280:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317508.301058:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317508.301113:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317508.301129:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894209152:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317508.302961:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894209536:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317508.309701:0:2501:0:(import.c:1990:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff9cfe18fd5f80 x1853163894209408/t0(0) o9->lustre-OST0000-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 224/224 e 0 to 0 dl 1767317518 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317508.309718:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe068ea000 lustre-OST0000_UUID: changing import state from CONNECTING to IDLE 00000100:00100000:1.0:1767317508.309722:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894209408:192.168.202.121@tcp:9:kworker.0 00000100:00100000:3.0:1767317509.060354:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317509.189108:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317510.084211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317510.213696:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317511.108548:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317511.237388:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317512.132658:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317512.260506:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317513.156264:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317513.284535:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317513.413124:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317513.413134:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317513.413137:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317513.413141:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317513.413145:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317513.413155:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2759 00000100:00080000:1.0:1767317513.413165:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317513.413190:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317513.413201:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317513.413249:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2680 x1853163894209664/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317513.413340:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894209920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317513.413452:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317513.413460:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894209792:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317513.413627:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894209664:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317513.431541:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894209792:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317513.447669:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894209920:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317513.457700:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317513.457716:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317513.457722:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894209664:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317514.180667:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317514.308418:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317515.204341:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317515.332392:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317516.228906:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317516.357764:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317517.252217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317517.380455:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317518.276625:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317518.406942:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317518.535062:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317518.535073:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317518.535076:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317518.535106:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317518.535111:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317518.535124:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2764 00000100:00080000:3.0:1767317518.535135:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317518.535145:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317518.535167:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317518.535272:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894210048/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317518.535341:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe068e9800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1767317518.535344:0:38:0:(import.c:2080:ptlrpc_disconnect_and_idle_import()) lustre-OST0001-osc-ffff9cfe08c17800: disconnect after 22s idle 00000100:00100000:3.0:1767317518.535367:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894210176:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317518.536053:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894210048:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317518.536117:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894210304:192.168.202.121@tcp:9:kworker.0 00000100:00100000:3.0:1767317518.543960:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894210176:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317518.544154:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317518.544161:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317518.544165:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894210048:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317518.544181:0:2501:0:(import.c:1990:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff9cfe18fd7100 x1853163894210304/t0(0) o9->lustre-OST0001-osc-ffff9cfe08c17800@192.168.202.121@tcp:28/4 lens 224/224 e 0 to 0 dl 1767317528 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317518.544189:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe068e9800 lustre-OST0001_UUID: changing import state from CONNECTING to IDLE 00000100:00100000:1.0:1767317518.544193:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894210304:192.168.202.121@tcp:9:kworker.0 00000100:00100000:3.0:1767317519.300221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317519.428824:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317520.324239:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317520.452761:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317521.348233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317521.477553:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317522.372217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317522.500551:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317523.396212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317523.524448:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317523.658522:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317523.658534:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317523.658537:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317523.658541:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317523.658546:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317523.658576:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2769 00000100:00080000:1.0:1767317523.658588:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317523.658595:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317523.658607:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317523.658641:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2d80 x1853163894210432/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317523.658696:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317523.658712:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894210560:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317523.659419:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317498/real 1767317498] req@ffff9cfe18fd5c00 x1853163894208000/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317523 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767317523.659446:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd5c00 x1853163894208000/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317523 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767317523.659460:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894210432:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767317523.659499:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317523.659513:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767317523.659518:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894208000:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317523.661341:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317523.661349:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317523.661353:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317523.661361:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2749 00000100:00080000:1.0:1767317523.661369:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317523.661376:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767317523.661408:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3100 x1853163894210688/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317523.662352:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894210688:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767317523.669303:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317523.669319:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317523.669324:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894210432:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317523.669555:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894210560:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317524.421554:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317524.553737:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317525.444250:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317525.573254:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317526.469342:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317526.597050:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317527.494483:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317527.622696:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317528.517201:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317528.644379:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317528.772305:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317528.772316:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317528.772319:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317528.772322:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317528.772327:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317528.772338:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2775 00000100:00080000:3.0:1767317528.772348:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317528.772356:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317528.772367:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317528.772403:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894210816/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317528.772475:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894210944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317528.772751:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894210816:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317528.783153:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1767317528.783160:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894210944:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317528.783168:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317528.783174:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894210816:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317529.543932:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317529.668569:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317530.564636:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317530.692940:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317531.588483:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317531.719388:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317532.616770:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317532.740304:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317533.636380:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317533.764358:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317533.893297:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317533.893325:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317533.893329:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317533.893333:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317533.893337:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317533.893349:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2780 00000100:00080000:2.0:1767317533.893360:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317533.893367:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317533.893379:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317533.893424:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894211072/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317533.893502:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317533.893518:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894211200:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317533.893865:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894211072:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317533.898174:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894211200:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317533.899265:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317533.899291:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317533.899296:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894211072:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317534.660348:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317534.788624:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317535.685680:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317535.812760:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317536.708249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317536.836497:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317537.732231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317537.860330:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317538.759809:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317538.886006:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317539.012556:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317539.012567:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317539.012571:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317539.012575:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317539.012580:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317539.012592:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2785 00000100:00080000:2.0:1767317539.012603:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317539.012609:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317539.012620:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317539.012665:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894211328/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317539.012747:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317539.012766:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894211456:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317539.013047:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894211328:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317539.023754:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317539.023771:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317539.023777:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894211328:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317539.023998:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894211456:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317539.780214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317539.908926:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317540.804255:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317540.933640:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317541.828495:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317541.956312:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317542.852225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317542.988354:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317543.876366:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317544.009002:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317544.132604:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317544.132616:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317544.132619:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317544.132624:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317544.132628:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317544.132639:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2790 00000100:00080000:3.0:1767317544.132650:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317544.132658:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317544.132670:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317544.132706:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894211584/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317544.132801:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894211712:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317544.135386:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894211584:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317544.138735:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894211712:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317544.138843:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317544.138850:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317544.138854:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894211584:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317544.900244:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317545.029296:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317545.924755:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317546.058582:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317546.948252:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317547.077112:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317547.973814:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317548.100823:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317548.228219:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317523/real 1767317523] req@ffff9cfe0f3d3100 x1853163894210688/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317548 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767317548.228251:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d3100 x1853163894210688/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317548 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767317548.228271:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317548.228298:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767317548.228302:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894210688:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767317548.228560:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317548.228566:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317548.228569:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317548.228574:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2775 00000100:00080000:3.0:1767317548.228584:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317548.228590:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767317548.228627:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894211840/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317548.228655:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317548.228659:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317548.228661:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317548.228664:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2795 00000100:00080000:3.0:1767317548.228686:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317548.228690:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317548.228699:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317548.228712:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894211968/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317548.228775:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894212096:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317548.229040:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894211840:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767317548.229125:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894211968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317548.232727:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894212096:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317548.237827:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317548.237844:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317548.237850:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894211968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317548.996732:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317549.126608:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317550.020254:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317550.148404:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317551.045746:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317551.174708:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317552.068215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317552.196282:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317553.092262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317553.220496:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317553.350853:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317553.350863:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317553.350866:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317553.350871:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317553.350875:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317553.350884:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2799 00000100:00080000:1.0:1767317553.350896:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317553.350904:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317553.350916:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317553.350955:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1c00 x1853163894212224/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317553.351113:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894212224:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317553.353523:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894212352:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317553.362992:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317553.363010:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317553.363014:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894212224:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317553.386742:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894212352:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317554.116205:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317554.245050:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317555.140329:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317555.270262:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317556.164348:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317556.293819:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317557.188260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317557.324299:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317558.212598:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317558.345468:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317558.468878:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317558.468900:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317558.468903:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317558.468908:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317558.468913:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317558.469026:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2804 00000100:00080000:3.0:1767317558.469038:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317558.469046:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317558.469061:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317558.469119:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6d80 x1853163894212480/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317558.469846:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894212480:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317558.470661:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894212608:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317558.477344:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317558.477360:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317558.477365:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894212480:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317558.488022:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894212608:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317559.236230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317559.364386:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317560.262132:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317560.391350:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317561.284284:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317561.414330:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317562.308219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317562.436318:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317563.332225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317563.460822:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317563.589299:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317563.589310:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317563.589313:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317563.589317:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317563.589321:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317563.589347:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2809 00000100:00080000:3.0:1767317563.589359:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317563.589366:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317563.589376:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317563.589419:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894212736/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317563.589484:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317563.589501:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894212864:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317563.590017:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894212736:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317563.594487:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317563.594503:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317563.594508:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894212736:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317563.594661:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894212864:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317564.356398:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317564.487331:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317565.380251:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317565.510291:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317566.404257:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317566.532485:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317567.428316:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317567.556685:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317568.452261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317568.580401:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317568.709951:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317568.709960:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317568.709963:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317568.709967:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317568.709985:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317568.709994:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2814 00000100:00080000:0.0:1767317568.710006:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317568.710013:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317568.710024:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317568.710053:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9180 x1853163894212992/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317568.710143:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317568.710158:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894213120:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317568.710402:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894212992:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317568.719545:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894213120:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317568.725351:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317568.725367:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317568.725372:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894212992:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317569.476646:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317569.604778:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317570.500228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317570.632595:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317571.524238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317571.653310:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317572.548230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317572.677112:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317573.573212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317573.704208:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317573.833099:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317573.833111:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317573.833114:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317573.833118:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317573.833123:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317573.833133:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2820 00000100:00080000:3.0:1767317573.833144:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317573.833151:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317573.833163:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317573.833199:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7100 x1853163894213248/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317573.833270:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317573.833286:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894213376:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317573.833588:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317548/real 1767317548] req@ffff9cfe18fd7800 x1853163894211840/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317573 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767317573.833607:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd7800 x1853163894211840/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317573 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767317573.833620:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894213248:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767317573.833663:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317573.833683:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767317573.833687:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894211840:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317573.834238:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317573.834244:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317573.834246:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317573.834251:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2799 00000100:00080000:1.0:1767317573.834256:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317573.834260:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767317573.834279:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2a00 x1853163894213504/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317573.834349:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894213504:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767317573.837462:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317573.837480:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317573.837485:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894213248:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317573.837882:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894213376:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317574.596228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317574.724425:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317575.620308:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317575.751138:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317576.644216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317576.774075:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317577.668272:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317577.797011:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317578.692226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317578.820308:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317578.948608:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317578.948620:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317578.948634:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317578.948638:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317578.948642:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317578.948652:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2825 00000100:00080000:2.0:1767317578.948663:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317578.948671:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317578.948683:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317578.948738:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894213632/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317578.948815:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317578.948828:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894213760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317578.949008:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894213632:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317578.954350:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317578.954371:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317578.954378:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894213632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317578.954495:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894213760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317579.718295:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317579.845175:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317580.740460:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317580.868603:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317581.764251:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317581.892880:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317582.788250:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317582.918218:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317583.812215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317583.942877:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317584.068308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317584.068321:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317584.068324:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317584.068328:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317584.068333:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317584.068344:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2830 00000100:00080000:3.0:1767317584.068355:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317584.068363:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317584.068387:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317584.068427:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894213888/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317584.068501:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317584.068516:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894214016:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317584.068927:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894213888:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317584.078865:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317584.078880:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317584.078885:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894213888:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317584.078992:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894214016:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317584.836226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317584.964589:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317585.860320:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317585.990163:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317586.884210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317587.013679:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317587.909776:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317588.036364:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317588.932583:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317589.062446:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317589.188227:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317589.188238:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317589.188242:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317589.188247:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317589.188251:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317589.188262:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2835 00000100:00080000:3.0:1767317589.188272:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317589.188299:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317589.188311:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317589.188341:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894214144/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317589.188412:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317589.188427:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894214272:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317589.188439:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894214144:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317589.199602:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894214272:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317589.202441:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317589.202456:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317589.202461:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894214144:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317589.956184:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317590.084440:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317590.980903:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317591.108334:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317592.004157:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317592.134073:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317593.028213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317593.158687:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317594.053218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317594.180880:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317594.308224:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317594.308236:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317594.308239:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317594.308243:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317594.308248:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317594.308257:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2840 00000100:00080000:0.0:1767317594.308268:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317594.308289:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317594.308300:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317594.308334:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8a80 x1853163894214400/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317594.308416:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894214528:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317594.309307:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894214400:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317594.314286:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894214528:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317594.314503:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317594.314511:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317594.314516:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894214400:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317595.076262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317595.207276:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317596.100239:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317596.229112:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317597.129144:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317597.252680:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317598.149076:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317598.276431:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317598.404252:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317573/real 1767317573] req@ffff9cfe0f3d2a00 x1853163894213504/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317598 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317598.404299:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d2a00 x1853163894213504/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317598 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317598.404652:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317598.404682:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767317598.404687:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894213504:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767317598.404759:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317598.404765:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767317598.404768:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317598.404773:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2825 00000100:00080000:2.0:1767317598.404783:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317598.404789:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767317598.404847:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894214656/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767317598.404866:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317598.404870:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317598.404872:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317598.404876:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2845 00000100:00080000:2.0:1767317598.404880:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317598.404885:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317598.404893:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317598.404895:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894214656:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767317598.404905:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894214784/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317598.404962:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317598.404972:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894214912:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317598.404974:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894214784:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317598.407737:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1767317598.407743:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894214912:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317598.407746:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317598.407750:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894214784:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317599.172222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317599.301340:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317600.196257:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317600.326904:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317601.222386:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317601.348644:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317602.244453:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317602.373048:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317603.268429:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317603.396837:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317603.524231:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317603.524243:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317603.524247:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317603.524251:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317603.524256:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317603.524267:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2849 00000100:00080000:2.0:1767317603.524279:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317603.524287:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317603.524311:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317603.524352:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894215040/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317603.524441:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317603.524455:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894215168:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317603.524619:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894215040:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317603.539042:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317603.539057:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317603.539064:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894215040:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317603.539151:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894215168:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317604.292217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317604.426852:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317605.316310:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317605.444561:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317606.340267:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317606.477286:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317607.364242:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317607.493157:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317608.388223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317608.516518:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317608.645496:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317608.645510:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317608.645514:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317608.645517:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317608.645523:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317608.645535:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2854 00000100:00080000:0.0:1767317608.645576:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317608.645583:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317608.645596:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317608.645632:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9880 x1853163894215296/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317608.645713:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317608.645733:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894215424:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317608.645784:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894215296:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317608.648888:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894215424:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317608.649307:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317608.649315:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317608.649319:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894215296:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317609.412327:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317609.540655:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317610.438319:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317610.564772:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317611.460259:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317611.588469:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317612.484294:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317612.612699:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317613.510411:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317613.636345:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317613.764475:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317613.764486:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317613.764489:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317613.764493:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317613.764498:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317613.764509:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2860 00000100:00080000:2.0:1767317613.764519:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317613.764525:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317613.764538:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317613.764574:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894215552/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317613.764672:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894215552:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317613.764795:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894215680:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317613.769226:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894215680:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317613.774108:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317613.774124:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317613.774129:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894215552:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317614.532296:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317614.661795:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317615.556384:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317615.688190:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317616.580230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317616.708331:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317617.605039:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317617.742459:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317618.631818:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317618.759252:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317618.884448:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317618.884459:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317618.884463:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317618.884468:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317618.884472:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317618.884481:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2865 00000100:00080000:2.0:1767317618.884492:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317618.884499:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317618.884526:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317618.884555:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894215808/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317618.884688:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894215808:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317618.887493:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894215936:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317618.889593:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317618.889603:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317618.889607:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894215808:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317618.890823:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894215936:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317619.653316:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317619.780578:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317620.677632:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317620.809797:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317621.700671:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317621.828482:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317622.725468:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317622.852503:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317623.748212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317623.876316:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317624.004431:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317598/real 1767317598] req@ffff9cfe29109180 x1853163894214656/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317623 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317624.004466:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29109180 x1853163894214656/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317623 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317624.004485:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317624.004523:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767317624.004528:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894214656:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767317624.004727:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317624.004734:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767317624.004737:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317624.004743:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2849 00000100:00080000:2.0:1767317624.004753:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317624.004760:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767317624.004791:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894216064/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767317624.004824:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317624.004828:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317624.004830:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317624.004833:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2870 00000100:00080000:2.0:1767317624.004837:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317624.004840:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317624.004849:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317624.004860:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894216192/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317624.004914:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317624.004926:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894216320:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317624.005411:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894216064:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767317624.005458:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894216192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317624.007955:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894216320:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317624.023694:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317624.023712:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317624.023717:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894216192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317624.772584:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317624.901950:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317625.796289:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317625.925641:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317626.820351:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317626.948382:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317627.848117:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317627.972334:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317628.870483:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317628.996426:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317629.126546:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317629.126557:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317629.126560:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317629.126564:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317629.126569:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317629.126600:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2875 00000100:00080000:3.0:1767317629.126612:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317629.126620:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317629.126635:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317629.126673:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894216448/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317629.126755:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317629.126772:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894216576:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317629.130519:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894216448:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317629.133911:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317629.133927:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317629.133932:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894216448:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317629.134021:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894216576:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317629.892223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317630.020742:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317630.916945:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317631.045718:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317631.940573:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317632.071003:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317632.964176:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317633.092501:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317633.988316:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317634.116307:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317634.244419:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317634.244430:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317634.244433:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317634.244437:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317634.244441:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317634.244452:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2880 00000100:00080000:1.0:1767317634.244463:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317634.244470:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317634.244482:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317634.244520:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2300 x1853163894216704/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317634.244599:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894216832:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317634.244621:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894216704:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317634.247409:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894216832:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317634.247552:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317634.247557:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317634.247560:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894216704:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317635.012837:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317635.141060:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317636.036261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317636.164796:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317637.060197:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317637.191274:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317638.084253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317638.212775:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317639.108345:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317639.236563:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317639.364263:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317639.364275:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317639.364278:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317639.364282:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317639.364288:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317639.364298:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2885 00000100:00080000:1.0:1767317639.364308:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317639.364316:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317639.364327:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317639.364362:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2300 x1853163894216960/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317639.364469:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894217088:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317639.364645:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894216960:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317639.373502:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894217088:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317639.374002:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317639.374010:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317639.374014:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894216960:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317640.132227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317640.260902:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317641.156300:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317641.285316:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317642.180326:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317642.309153:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317643.204229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317643.332651:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317644.228593:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317644.357276:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317644.484318:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317644.484327:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317644.484330:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317644.484334:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317644.484338:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317644.484353:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2890 00000100:00080000:3.0:1767317644.484363:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317644.484369:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317644.484380:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317644.484413:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4380 x1853163894217216/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317644.484470:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894217216:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317644.484808:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317644.484819:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894217344:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317644.491298:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317644.491329:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317644.491335:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894217216:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317644.491448:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894217344:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317645.252246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317645.387444:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317646.276230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317646.404741:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317647.301386:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317647.428394:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317648.324197:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317648.452619:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317649.348225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317649.478554:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317649.604211:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317624/real 1767317624] req@ffff9cfe29109f80 x1853163894216064/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317649 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767317649.604261:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29109f80 x1853163894216064/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317649 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767317649.604282:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317649.604313:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767317649.604325:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894216064:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317649.604368:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317649.604375:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317649.604378:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317649.604384:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2875 00000100:00080000:1.0:1767317649.604394:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317649.604401:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767317649.604435:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2300 x1853163894217472/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767317649.604466:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317649.604470:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317649.604472:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317649.604476:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2895 00000100:00080000:1.0:1767317649.604480:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317649.604484:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317649.604492:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317649.604504:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3800 x1853163894217600/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317649.604605:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894217472:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767317649.604702:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894217600:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317649.604862:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894217728:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317649.608963:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894217728:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317649.609063:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317649.609070:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317649.609074:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894217600:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317650.372801:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317650.504637:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317651.397860:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317651.524582:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317652.421280:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317652.549476:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317653.444223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317653.572338:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317654.468253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317654.598021:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317654.724904:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317654.724910:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317654.724913:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317654.724916:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317654.724920:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317654.724928:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2900 00000100:00080000:2.0:1767317654.724937:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317654.724942:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317654.724951:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317654.724979:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894217856/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317654.725533:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894217856:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317654.725720:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894217984:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317654.732787:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317654.732817:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317654.732822:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894217856:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317654.739269:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894217984:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317655.498325:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317655.620297:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317656.516302:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317656.644288:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317657.540607:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317657.668963:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317658.564286:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317658.692732:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317659.588327:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317659.716962:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317659.844364:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317659.844378:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317659.844381:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317659.844384:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317659.844387:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317659.844396:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2906 00000100:00080000:3.0:1767317659.844404:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317659.844409:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317659.844418:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317659.844445:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6680 x1853163894218112/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317659.844518:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317659.844536:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894218240:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317659.845419:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894218112:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317659.848225:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317659.848246:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317659.848254:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894218112:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317659.848294:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894218240:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317660.612327:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317660.740829:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317661.636460:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317661.764256:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317662.660750:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317662.788914:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317663.684214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317663.812553:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317664.708525:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317664.836316:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317664.964728:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317664.964754:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317664.964758:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317664.964761:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317664.964765:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317664.964775:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2911 00000100:00080000:2.0:1767317664.964784:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317664.964792:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317664.964803:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317664.964838:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910a680 x1853163894218368/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317664.964924:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317664.964938:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894218496:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317664.966402:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894218368:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317664.969148:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317664.969162:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317664.969166:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894218368:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317664.969422:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894218496:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317665.732266:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317665.863649:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317666.758291:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317666.884290:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317667.781509:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317667.908406:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317668.804296:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317668.932375:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317669.831378:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317669.956419:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317670.085476:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317670.085485:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317670.085488:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317670.085492:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317670.085497:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317670.085506:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2916 00000100:00080000:1.0:1767317670.085516:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317670.085523:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317670.085535:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317670.085570:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3800 x1853163894218624/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317670.085713:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894218752:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317670.088368:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894218624:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767317670.102119:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317670.102133:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317670.102138:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894218624:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317670.112925:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894218752:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317670.853288:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317670.980539:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317671.877908:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317672.004660:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317672.900211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317673.029222:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317673.934302:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317674.052359:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317674.180243:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317649/real 1767317649] req@ffff9cfe0f3d2300 x1853163894217472/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317674 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767317674.180280:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d2300 x1853163894217472/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317674 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767317674.180301:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317674.180927:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767317674.180934:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894217472:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317674.181003:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317674.181010:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317674.181013:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317674.181019:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2900 00000100:00080000:1.0:1767317674.181028:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317674.181034:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767317674.181070:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3b80 x1853163894218880/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317674.181189:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894218880:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317674.181378:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317674.181383:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317674.181386:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317674.181391:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2921 00000100:00080000:1.0:1767317674.181396:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317674.181402:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317674.181414:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317674.181429:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1180 x1853163894219008/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317674.181749:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894219008:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317674.183029:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894219136:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317674.187776:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894219136:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317674.191708:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317674.191726:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317674.191732:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894219008:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317674.948304:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317675.077522:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317675.972227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317676.100410:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317676.996222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317677.124394:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317678.020249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317678.148344:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317679.045554:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317679.172403:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317679.301269:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317679.301280:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317679.301283:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317679.301286:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317679.301291:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317679.301302:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2925 00000100:00080000:3.0:1767317679.301313:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317679.301321:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317679.301333:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317679.301369:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4380 x1853163894219264/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317679.301436:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317679.301455:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894219392:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317679.301660:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894219264:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317679.315840:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317679.315855:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317679.315861:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894219264:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317679.320655:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894219392:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317680.068973:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317680.198126:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317681.092451:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317681.220938:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317682.116215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317682.244526:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317683.140360:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317683.268307:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317684.164295:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317684.293998:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317684.420246:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317684.420257:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317684.420261:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317684.420265:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317684.420292:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317684.420301:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2930 00000100:00080000:3.0:1767317684.420311:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317684.420318:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317684.420330:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317684.420360:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894219520/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317684.420420:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894219520:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317684.420432:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317684.420441:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894219648:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317684.436192:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894219648:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317684.436406:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317684.436414:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317684.436417:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894219520:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317685.188293:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317685.317820:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317686.212247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317686.340491:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317687.238808:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317687.364292:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317688.260216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317688.389966:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317689.284470:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317689.412399:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317689.540918:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317689.540932:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317689.540936:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317689.540939:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317689.540945:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317689.540957:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2935 00000100:00080000:0.0:1767317689.540984:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317689.540991:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317689.541002:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317689.541043:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb480 x1853163894219776/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317689.541135:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894219904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317689.541423:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894219776:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317689.554865:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317689.554879:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317689.554885:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894219776:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317689.563417:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894219904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317690.308514:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317690.443973:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317691.332181:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317691.460322:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317692.356227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317692.485067:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317693.380228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317693.509326:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317694.405754:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317694.532513:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317694.660328:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317694.660338:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317694.660341:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317694.660345:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317694.660349:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317694.660360:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2940 00000100:00080000:3.0:1767317694.660387:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317694.660394:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317694.660406:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317694.660436:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894220032/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317694.660507:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317694.660525:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894220160:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317694.661621:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894220032:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317694.662996:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894220160:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317694.664579:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317694.664593:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317694.664598:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894220032:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317695.428315:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317695.556723:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317696.452516:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317696.581857:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317697.476239:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317697.604403:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317698.500213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317698.628362:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317699.525253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317699.652302:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317699.782842:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1767317699.782844:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317674/real 1767317674] req@ffff9cfe0f3d3b80 x1853163894218880/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317699 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317699.782852:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317699.782857:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317699.782864:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317699.782870:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317699.782877:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2946 00000100:00100000:3.0:1767317699.782886:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d3b80 x1853163894218880/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317699 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317699.782887:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317699.782897:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317699.782910:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00080000:3.0:1767317699.782910:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317699.782936:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767317699.782941:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894218880:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767317699.782947:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0a80 x1853163894220288/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317699.782994:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894220288:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317699.783022:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317699.783027:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317699.783029:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317699.783034:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2925 00000100:00080000:1.0:1767317699.783210:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317699.783218:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767317699.783232:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3100 x1853163894220544/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317699.783332:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894220416:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317699.783547:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894220544:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767317699.791584:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317699.791600:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317699.791619:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894220288:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317699.791791:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894220416:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317700.548264:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317700.682004:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317701.572549:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317701.700656:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317702.596233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317702.724377:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317703.620941:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317703.749739:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317704.644213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317704.772635:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317704.902553:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317704.902563:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317704.902566:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317704.902570:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317704.902575:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317704.902585:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2951 00000100:00080000:3.0:1767317704.902605:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317704.902612:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317704.902625:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317704.902661:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894220672/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317704.903122:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894220672:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317704.904588:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894220800:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317704.911449:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317704.911464:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317704.911482:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894220672:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317704.913201:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894220800:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317705.668180:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317705.796326:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317706.692202:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317706.820438:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317707.716586:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317707.844555:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317708.740204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317708.871004:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317709.765175:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317709.893180:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317710.022158:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317710.022167:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317710.022170:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317710.022174:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317710.022178:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317710.022205:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2956 00000100:00080000:2.0:1767317710.022298:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317710.022305:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317710.022317:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317710.022350:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894220928/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317710.022438:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894221056:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317710.024526:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894220928:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317710.041566:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894221056:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767317710.042962:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317710.042989:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317710.042994:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894220928:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317710.788640:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317710.916592:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317711.814445:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317711.940319:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317712.836438:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317712.964493:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317713.860163:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317713.988385:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317714.885600:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317715.012384:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317715.140422:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317715.140433:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317715.140436:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317715.140439:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317715.140444:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317715.140454:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2961 00000100:00080000:3.0:1767317715.140467:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317715.140474:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317715.140486:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317715.140557:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7100 x1853163894221184/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317715.140614:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317715.140626:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894221312:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317715.140877:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894221184:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317715.155897:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317715.155912:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317715.155917:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894221184:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317715.155991:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894221312:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317715.908409:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317716.036879:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317716.933887:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317717.060416:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317717.956288:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317718.084445:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317718.980901:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317719.108954:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317720.004236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317720.132537:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317720.260618:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317720.260629:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317720.260632:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317720.260636:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317720.260641:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317720.260653:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2966 00000100:00080000:1.0:1767317720.260666:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317720.260675:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317720.260686:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317720.260720:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2d80 x1853163894221440/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317720.260867:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894221568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317720.261629:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894221440:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317720.269699:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317720.269713:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317720.269731:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894221440:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317720.270044:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894221568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317721.028195:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317721.157067:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317722.052228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317722.181895:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317723.076348:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317723.209273:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317724.100615:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317724.228375:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317724.356243:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317699/real 1767317699] req@ffff9cfe0f3d3100 x1853163894220544/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317724 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317724.356280:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d3100 x1853163894220544/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317724 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317724.356300:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317724.356328:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767317724.356332:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894220544:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767317724.358407:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317724.358416:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767317724.358450:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317724.358464:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2951 00000100:00080000:2.0:1767317724.358473:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317724.358480:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767317724.358528:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894221696/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767317724.358568:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317724.358572:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317724.358573:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317724.358577:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2971 00000100:00080000:2.0:1767317724.358581:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317724.358585:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317724.358802:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317724.358818:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894221824/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317724.358894:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317724.358911:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894221952:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317724.360124:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894221696:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767317724.360196:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894221824:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317724.370328:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894221952:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317724.371004:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317724.371012:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317724.371017:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894221824:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317725.124222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317725.252457:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317726.148171:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317726.276385:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317727.172688:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317727.301950:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317728.196212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317728.324496:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317729.220938:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317729.348364:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317729.476813:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317729.476824:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317729.476827:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317729.476831:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317729.476836:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317729.476846:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2975 00000100:00080000:1.0:1767317729.476857:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317729.476864:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317729.476895:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317729.476929:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3100 x1853163894222080/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317729.476994:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894222208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317729.477337:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894222080:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767317729.487198:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317729.487214:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767317729.487219:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894222080:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317729.487354:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894222208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317730.244215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317730.372590:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317731.268736:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317731.396592:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317732.292234:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317732.420763:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317733.316264:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317733.447481:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317734.340222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317734.468297:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317734.596231:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317734.596242:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317734.596244:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317734.596248:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317734.596251:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317734.596261:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2980 00000100:00080000:1.0:1767317734.596272:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317734.596279:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317734.596289:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317734.596324:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2d80 x1853163894222336/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317734.596415:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317734.596427:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894222464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317734.596961:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894222336:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767317734.604132:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317734.604148:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317734.604154:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894222336:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317734.604250:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894222464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317735.364271:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317735.493227:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317736.390487:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317736.516324:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317737.412553:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317737.541277:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317738.436264:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317738.565698:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317739.460246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317739.589400:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317739.716707:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317739.716719:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317739.716721:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317739.716725:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317739.716729:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317739.716740:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2985 00000100:00080000:2.0:1767317739.716751:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317739.716758:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317739.716770:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317739.716809:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894222592/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317739.716883:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894222720:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317739.716886:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894222592:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317739.728955:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894222720:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317739.729636:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317739.729646:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317739.729650:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894222592:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317740.484318:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317740.612939:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317741.508362:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317741.636357:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317742.532217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317742.660377:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317743.556242:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317743.685156:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317744.580996:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317744.708380:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317744.838388:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317744.838415:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317744.838418:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317744.838421:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317744.838426:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317744.838436:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2991 00000100:00080000:2.0:1767317744.838447:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317744.838454:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317744.838464:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317744.838496:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894222848/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317744.838581:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894222976:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317744.838880:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894222848:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317744.841170:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894222976:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317744.844174:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317744.844189:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317744.844194:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894222848:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317745.605140:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317745.734951:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317746.628185:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317746.756567:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317747.652201:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317747.784320:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317748.676229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317748.804412:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317749.701796:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317749.828393:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317749.956251:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317724/real 1767317724] req@ffff9cfe29108a80 x1853163894221696/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317749 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767317749.956294:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29108a80 x1853163894221696/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317749 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767317749.956317:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317749.956326:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767317749.956330:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894221696:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317749.956544:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317749.956550:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317749.956568:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317749.956573:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 2975 00000100:00080000:1.0:1767317749.956581:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317749.956587:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767317749.956617:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0700 x1853163894223104/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767317749.956644:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317749.956648:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317749.956650:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317749.956654:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 2996 00000100:00080000:1.0:1767317749.956657:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317749.956660:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317749.956668:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317749.956680:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0380 x1853163894223232/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317749.956729:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894223360:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317749.957056:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894223104:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767317749.957116:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894223232:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317749.960910:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894223360:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317749.961160:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317749.961167:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317749.961172:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894223232:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317750.726110:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317750.855829:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317751.748253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317751.876769:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317752.774336:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317752.900787:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317753.797291:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317753.925660:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317754.820228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317754.952936:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317755.076925:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317755.076932:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317755.076935:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317755.076939:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317755.076944:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317755.076953:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3001 00000100:00080000:3.0:1767317755.076964:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317755.076986:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317755.076997:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317755.077027:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894223488/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317755.077139:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894223616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317755.077352:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894223488:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317755.090676:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317755.090692:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317755.090697:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894223488:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317755.090909:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894223616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317755.844205:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317755.972327:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317756.870949:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317756.998072:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317757.895199:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317758.020294:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317758.918256:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317759.045033:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317759.940214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317760.068529:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317760.196697:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317760.196708:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317760.196711:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317760.196715:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317760.196719:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317760.196729:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3006 00000100:00080000:3.0:1767317760.196739:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317760.196746:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317760.196757:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317760.196806:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894223744/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317760.196877:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894223872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317760.197190:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894223744:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317760.199546:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317760.199576:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317760.199581:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894223744:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317760.199779:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894223872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317760.966459:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317761.093801:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317761.988233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317762.119271:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317763.012177:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317763.141914:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317764.036260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317764.164662:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317765.060432:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317765.189632:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317765.316259:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317765.316276:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317765.316279:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317765.316284:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317765.316289:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317765.316299:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3011 00000100:00080000:1.0:1767317765.316328:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317765.316335:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317765.316346:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317765.316378:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1500 x1853163894224000/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317765.316447:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894224128:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317765.316775:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894224000:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317765.319140:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894224128:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317765.319277:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317765.319284:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317765.319289:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894224000:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317766.084434:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317766.213867:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317767.108226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317767.236611:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317768.132261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317768.260482:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317769.156300:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317769.284546:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317770.180189:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317770.308868:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317770.437316:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317770.437325:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317770.437328:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317770.437332:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317770.437336:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317770.437347:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3016 00000100:00080000:3.0:1767317770.437358:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317770.437365:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317770.437376:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317770.437420:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894224256/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317770.437492:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767317770.437512:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894224384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317770.438058:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894224256:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767317770.440052:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317770.440064:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317770.440069:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894224256:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317770.440176:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894224384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317771.204249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317771.332337:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317772.228234:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317772.356636:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317773.252218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317773.380443:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317774.276228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317774.405376:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767317774.532326:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317749/real 1767317749] req@ffff9cfe0f3d0700 x1853163894223104/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317774 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767317774.532361:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0700 x1853163894223104/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317774 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767317774.532380:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317774.532409:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767317774.532414:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894223104:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767317774.533865:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317774.533890:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317774.533893:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317774.533902:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3001 00000100:00080000:3.0:1767317774.533913:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317774.533920:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767317774.533951:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6d80 x1853163894224512/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317774.533990:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317774.533993:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317774.533995:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317774.533998:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3021 00000100:00080000:3.0:1767317774.534002:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317774.534005:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317774.534014:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317774.534025:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894224640/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317774.534111:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317774.534130:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894224768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317774.534236:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894224512:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767317774.534277:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894224640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317774.536227:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894224768:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317774.540819:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317774.540838:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317774.540845:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894224640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317775.300558:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317775.428347:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317776.324272:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317776.456128:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317777.348212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317777.476477:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317778.372375:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317778.500877:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317779.396274:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317779.524306:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317779.658228:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317779.658239:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317779.658242:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317779.658246:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317779.658251:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317779.658262:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3025 00000100:00080000:1.0:1767317779.658274:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317779.658280:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317779.658292:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317779.658326:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0700 x1853163894224896/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317779.658403:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894225024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317779.661124:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894224896:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317779.662009:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894225024:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317779.668314:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317779.668346:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317779.668353:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894224896:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317780.420212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317780.548636:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317781.446497:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317781.572282:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317782.469965:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317782.597250:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317783.495207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317783.620327:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317784.521990:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317784.647711:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317784.772345:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317784.772355:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317784.772358:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317784.772362:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317784.772367:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317784.772376:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3031 00000100:00080000:2.0:1767317784.772388:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317784.772395:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317784.772406:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317784.772441:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894225152/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317784.772513:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317784.772526:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894225280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317784.772939:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894225152:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317784.776798:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894225280:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317784.776938:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317784.776946:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317784.776950:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894225152:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317785.540382:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317785.668565:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317786.564214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317786.692881:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317787.588508:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317787.716329:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317788.612289:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317788.740870:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317789.636520:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317789.765419:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317789.893172:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317789.893181:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317789.893184:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317789.893188:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317789.893202:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317789.893212:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3036 00000100:00080000:3.0:1767317789.893221:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317789.893228:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317789.893239:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317789.893278:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894225408/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317789.893350:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317789.893368:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894225536:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317789.894549:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894225408:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317789.895942:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894225536:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767317789.899797:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767317789.899812:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767317789.899818:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894225408:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317790.667043:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317790.788338:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317791.684280:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317791.812608:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317792.708232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317792.836324:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317793.732215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317793.860653:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317794.756232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317794.884269:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317795.013383:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317795.013394:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317795.013396:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317795.013400:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317795.013406:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317795.013416:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3041 00000100:00080000:2.0:1767317795.013429:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317795.013437:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317795.013450:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317795.013487:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894225664/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317795.013575:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317795.013591:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894225792:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317795.014115:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894225664:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317795.016570:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317795.016583:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317795.016606:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894225664:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317795.018355:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894225792:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317795.780271:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317795.908918:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317796.804900:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317796.935820:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317797.831110:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317797.957833:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317798.852486:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317798.980865:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317799.108796:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317774/real 1767317774] req@ffff9cfe18fd6d80 x1853163894224512/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317799 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317799.108828:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd6d80 x1853163894224512/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317799 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317799.108848:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317799.108862:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767317799.108866:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894224512:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317799.109008:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317799.109013:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317799.109016:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317799.109021:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3025 00000100:00080000:1.0:1767317799.109030:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317799.109036:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767317799.109065:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3480 x1853163894225920/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767317799.109106:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317799.109110:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317799.109112:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317799.109115:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3046 00000100:00080000:1.0:1767317799.109118:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317799.109122:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317799.109137:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317799.109147:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0000 x1853163894226048/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317799.109188:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894226176:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317799.110176:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894225920:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767317799.110240:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894226048:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317799.113369:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894226176:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317799.115484:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317799.115498:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317799.115503:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894226048:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317799.876272:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317800.004592:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317800.900219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317801.029903:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317801.924215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317802.052273:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317802.948526:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317803.076327:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317803.972215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317804.100402:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317804.228207:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317804.228218:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317804.228220:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317804.228224:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317804.228229:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317804.228239:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3050 00000100:00080000:1.0:1767317804.228249:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317804.228256:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317804.228267:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317804.228301:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0e00 x1853163894226304/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317804.228368:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894226432:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317804.228656:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894226304:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317804.230819:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894226432:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317804.232640:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317804.232653:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317804.232659:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894226304:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317804.996829:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317805.124429:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317806.023147:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317806.148337:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317807.045334:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317807.175826:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317808.069378:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317808.196371:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317809.092567:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317809.220595:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317809.348232:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317809.348244:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317809.348246:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317809.348250:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317809.348254:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317809.348264:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3055 00000100:00080000:3.0:1767317809.348275:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317809.348282:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317809.348293:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317809.348337:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894226560/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317809.348412:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894226560:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317809.349821:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894226688:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317809.360122:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894226688:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317809.360429:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317809.360436:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317809.360440:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894226560:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317810.116322:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317810.245293:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317811.140290:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317811.268968:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317812.164568:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317812.292278:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317813.189491:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317813.316576:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317814.214904:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317814.340323:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317814.468254:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317814.468265:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317814.468268:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317814.468272:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317814.468280:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317814.468291:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3060 00000100:00080000:1.0:1767317814.468303:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317814.468310:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317814.468341:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317814.468374:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1880 x1853163894226816/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317814.468459:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317814.468471:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894226944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317814.468726:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894226816:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767317814.473161:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317814.473180:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317814.473201:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894226816:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317814.475026:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894226944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317815.236216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317815.364503:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317816.260286:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317816.388943:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317817.284209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317817.413160:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317818.308728:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317818.436624:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317819.332208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317819.460385:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317819.588315:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317819.588324:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317819.588328:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317819.588332:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317819.588337:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317819.588348:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3065 00000100:00080000:3.0:1767317819.588360:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317819.588367:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317819.588377:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317819.588408:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894227072/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317819.588493:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894227072:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317819.588621:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894227200:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317819.592233:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317819.592246:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317819.592251:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894227072:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317819.592442:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894227200:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317820.358166:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317820.484503:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317821.380232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317821.508452:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317822.404209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317822.533121:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317823.428319:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317823.556463:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317824.452232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317824.580269:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317824.708230:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317799/real 1767317799] req@ffff9cfe0f3d3480 x1853163894225920/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317824 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317824.708288:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d3480 x1853163894225920/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317824 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767317824.709190:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317824.709207:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317824.709209:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317824.709212:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317824.709215:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317824.709221:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3070 00000100:00080000:3.0:1767317824.709230:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317824.709237:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317824.709247:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317824.709279:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894227328/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317824.709346:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767317824.709365:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894227456:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317824.712610:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894227328:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317824.712720:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317824.712749:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767317824.712754:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894225920:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317824.713110:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317824.713116:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317824.713120:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317824.713126:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3050 00000100:00080000:1.0:1767317824.713132:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317824.713139:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767317824.713160:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894227456:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317824.713167:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0e00 x1853163894227584/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317824.713302:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894227584:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767317824.719271:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317824.719289:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317824.719295:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894227328:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317825.476331:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317825.604640:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317826.500277:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317826.628383:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317827.524621:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317827.652326:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317828.548624:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317828.676743:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317829.572221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317829.700466:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317829.830000:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317829.830011:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317829.830014:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317829.830018:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317829.830024:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317829.830035:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3076 00000100:00080000:2.0:1767317829.830045:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317829.830053:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317829.830066:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317829.830124:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894227712/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317829.830216:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317829.830233:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894227840:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317829.830852:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894227712:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317829.839935:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894227840:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317829.842094:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317829.842110:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317829.842116:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894227712:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317830.596175:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317830.725660:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317831.620263:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317831.750047:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317832.646142:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317832.772390:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317833.668280:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317833.796444:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317834.693577:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317834.820472:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317834.948696:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317834.948710:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317834.948713:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317834.948717:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317834.948722:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317834.948733:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3081 00000100:00080000:1.0:1767317834.948745:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317834.948755:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317834.948770:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317834.948860:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0000 x1853163894227968/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317834.948974:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317834.948990:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894228096:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317834.949229:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894227968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317834.955959:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894228096:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317834.963903:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317834.963919:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317834.963923:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894227968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317835.716240:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317835.844676:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317836.743556:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317836.887501:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317837.764331:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317837.892556:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317838.790663:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317838.919167:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317839.812290:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317839.940398:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317840.068371:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317840.068393:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317840.068396:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317840.068400:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317840.068404:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317840.068416:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3086 00000100:00080000:0.0:1767317840.068429:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317840.068438:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317840.068450:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317840.068491:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb800 x1853163894228224/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317840.068633:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894228224:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317840.068798:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894228352:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317840.072751:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317840.072769:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317840.072775:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894228224:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317840.073153:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894228352:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317840.838021:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317840.964359:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317841.865255:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317841.992879:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317842.884708:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317843.014139:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317843.909048:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317844.041062:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317844.936134:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317845.061720:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317845.188381:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317845.188419:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317845.188422:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317845.188426:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317845.188430:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317845.188440:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3091 00000100:00080000:2.0:1767317845.188450:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317845.188457:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317845.188468:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317845.188502:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894228480/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317845.188636:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894228608:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317845.188795:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894228480:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317845.204797:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894228608:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317845.205850:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317845.205861:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317845.205866:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894228480:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317845.956288:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317846.087212:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317846.980264:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317847.111231:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317848.004356:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317848.132395:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317849.028231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317849.157647:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317849.284218:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317824/real 1767317824] req@ffff9cfe0f3d0e00 x1853163894227584/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317849 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317849.284254:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0e00 x1853163894227584/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317849 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317849.284274:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317849.284309:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767317849.284314:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894227584:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767317849.284635:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317849.284641:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767317849.284644:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317849.284650:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3076 00000100:00080000:2.0:1767317849.284659:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317849.284676:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767317849.284718:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894228736/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767317849.284741:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317849.284745:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317849.284762:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317849.284766:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3096 00000100:00080000:2.0:1767317849.284770:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317849.284774:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317849.284783:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317849.284794:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894228864/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317849.284844:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317849.284857:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894228992:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317849.285857:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894228736:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767317849.285924:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894228864:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317849.291328:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894228992:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317849.291463:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317849.291470:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317849.291474:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894228864:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317850.052176:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317850.182166:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317851.076511:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317851.212740:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317852.102754:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317852.231718:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317853.124252:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317853.252378:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317854.148294:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317854.276905:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317854.404834:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317854.404845:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317854.404857:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317854.404862:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317854.404866:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317854.404876:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3100 00000100:00080000:1.0:1767317854.404887:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317854.404893:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317854.404904:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317854.404940:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0700 x1853163894229120/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317854.405013:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317854.405029:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894229248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317854.406115:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894229120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317854.423011:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894229248:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317854.423384:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317854.423392:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317854.423396:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894229120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317855.172259:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317855.300466:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317856.196173:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317856.325854:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317857.220281:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317857.350754:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317858.245802:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317858.375373:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317859.268267:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317859.396956:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317859.524332:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317859.524342:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317859.524345:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317859.524349:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317859.524353:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317859.524364:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3105 00000100:00080000:2.0:1767317859.524470:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317859.524479:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317859.524510:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317859.524544:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894229376/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317859.524628:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894229376:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317859.525779:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894229504:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317859.541984:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317859.542000:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317859.542007:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894229376:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317859.542032:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894229504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317860.292254:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317860.420295:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317861.316225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317861.444648:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317862.343622:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317862.468356:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317863.364410:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317863.492411:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317864.388252:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317864.516493:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317864.646943:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317864.646954:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317864.646957:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317864.646961:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317864.646966:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317864.646976:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3110 00000100:00080000:2.0:1767317864.646988:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317864.646995:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317864.647007:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317864.647044:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894229632/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317864.651729:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894229632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317864.654625:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894229760:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317864.670292:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317864.670307:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317864.670313:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894229632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317864.678062:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894229760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317865.414411:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317865.540380:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317866.436297:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317866.564549:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317867.460219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317867.589132:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317868.484833:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317868.612556:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317869.509072:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317869.637814:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317869.764269:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317869.764281:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317869.764284:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317869.764289:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317869.764293:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317869.764305:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3116 00000100:00080000:2.0:1767317869.764318:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317869.764353:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317869.764368:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317869.764408:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894229888/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317869.764843:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894230016:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317869.765369:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894229888:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317869.768481:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317869.768497:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317869.768502:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894229888:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317869.768770:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894230016:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317870.532249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317870.660564:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317871.557485:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317871.684324:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317872.580227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317872.708324:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317873.604259:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317873.732259:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317874.628258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317874.757952:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317874.885166:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317849/real 1767317849] req@ffff9cfe29108a80 x1853163894228736/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317874 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317874.885206:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29108a80 x1853163894228736/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317874 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317874.885242:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317874.885273:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767317874.885277:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894228736:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767317874.885796:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317874.885802:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767317874.885805:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317874.885828:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3100 00000100:00080000:3.0:1767317874.885837:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317874.885844:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767317874.885886:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894230144/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767317874.885911:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317874.885915:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317874.885917:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317874.885921:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3121 00000100:00080000:3.0:1767317874.885924:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317874.885928:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317874.885937:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317874.885962:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7100 x1853163894230272/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317874.886068:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894230400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317874.886355:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894230144:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767317874.886413:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894230272:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317874.890329:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317874.890347:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317874.890352:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894230272:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317874.890716:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894230400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317875.652453:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317875.781729:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317876.676249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317876.806623:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317877.700259:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317877.830420:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317878.725950:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317878.854536:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317879.748642:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317879.876363:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317880.005400:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317880.005422:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317880.005425:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317880.005428:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317880.005432:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317880.005442:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3126 00000100:00080000:3.0:1767317880.005453:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317880.005461:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317880.005471:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317880.005512:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894230528/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317880.005765:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894230656:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317880.006038:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894230528:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317880.012006:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894230656:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317880.012381:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317880.012389:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317880.012393:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894230528:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317880.772226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317880.903687:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317881.800934:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317881.924535:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317882.821236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317882.948446:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317883.844232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317883.972459:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317884.868218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317884.996342:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317885.124680:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317885.124695:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317885.124698:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317885.124704:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317885.124709:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317885.124723:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3131 00000100:00080000:0.0:1767317885.124739:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317885.124748:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317885.124765:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317885.124817:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb800 x1853163894230784/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317885.124906:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767317885.124929:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894230912:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317885.125381:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894230784:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767317885.130448:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317885.130469:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317885.130475:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894230784:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317885.130685:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894230912:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317885.892361:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317886.020418:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317886.916972:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317887.044577:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317887.940262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317888.068541:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317888.964247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317889.093974:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317889.988665:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317890.117823:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317890.244405:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317890.244415:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317890.244418:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317890.244422:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317890.244426:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317890.244435:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3136 00000100:00080000:1.0:1767317890.244446:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317890.244453:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317890.244463:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317890.244498:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1500 x1853163894231040/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317890.244591:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317890.244608:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894231168:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317890.245025:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894231040:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767317890.265150:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317890.265189:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317890.265195:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894231040:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317890.266878:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894231168:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317891.013016:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317891.148356:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317892.036218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317892.164433:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317893.060212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317893.190236:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317894.084896:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317894.212303:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317895.108244:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317895.236703:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767317895.366190:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317895.366201:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767317895.366204:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767317895.366208:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767317895.366213:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767317895.366224:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3141 00000100:00080000:3.0:1767317895.366234:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767317895.366242:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767317895.366264:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767317895.366298:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894231296/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317895.367421:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894231296:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317895.367617:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894231424:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317895.371126:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894231424:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317895.371633:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317895.371647:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317895.371651:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894231296:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317896.132541:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317896.262594:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317897.156315:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317897.287923:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317898.183754:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317898.308856:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317899.204214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317899.332340:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317899.460259:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317874/real 1767317874] req@ffff9cfe18fd7800 x1853163894230144/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317899 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317899.460290:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd7800 x1853163894230144/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317899 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317899.460309:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317899.460318:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767317899.460322:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894230144:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317899.460451:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317899.460456:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317899.460459:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317899.460464:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3126 00000100:00080000:1.0:1767317899.460472:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317899.460478:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767317899.460507:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0380 x1853163894231552/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767317899.460558:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317899.460561:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317899.460563:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317899.460567:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3146 00000100:00080000:1.0:1767317899.460570:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317899.460574:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317899.460582:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317899.460592:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2d80 x1853163894231680/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317899.460632:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894231808:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317899.461372:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894231552:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767317899.461423:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894231680:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317899.465136:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894231808:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317899.465251:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317899.465256:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317899.465259:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894231680:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317900.228807:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317900.357041:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317901.252244:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317901.380321:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317902.276268:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317902.406462:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317903.300955:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317903.428336:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317904.324352:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317904.452546:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317904.583072:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317904.583101:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317904.583105:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317904.583109:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317904.583113:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317904.583124:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3150 00000100:00080000:2.0:1767317904.583135:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317904.583141:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317904.583152:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317904.583832:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910a680 x1853163894231936/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317904.583947:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767317904.583963:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894232064:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317904.584356:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894231936:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317904.600627:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894232064:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317904.602400:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317904.602435:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317904.602440:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894231936:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317905.348239:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317905.477655:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317906.373066:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317906.500551:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317907.396285:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317907.524782:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317908.422613:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317908.551037:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317909.445377:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317909.576799:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317909.700750:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317909.700762:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317909.700765:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317909.700770:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317909.700775:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317909.700789:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3155 00000100:00080000:0.0:1767317909.700800:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317909.700817:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317909.700830:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317909.700868:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb100 x1853163894232192/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317909.700991:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894232192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317909.701450:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894232320:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317909.707412:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317909.707431:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317909.707437:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894232192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317909.707555:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894232320:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317910.468503:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317910.596307:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317911.494232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317911.625420:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317912.516265:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317912.646608:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317913.543985:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317913.668660:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317914.566005:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317914.692477:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317914.820255:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317914.820266:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317914.820269:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317914.820273:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317914.820278:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317914.820289:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3161 00000100:00080000:1.0:1767317914.820301:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317914.820326:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317914.820337:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317914.820374:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3100 x1853163894232448/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317914.820459:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767317914.820480:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894232576:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317914.821141:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894232448:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767317914.842475:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317914.842496:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317914.842502:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894232448:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317914.843901:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894232576:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317915.588258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317915.716315:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317916.612655:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317916.740261:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317917.637750:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317917.764688:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317918.660678:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317918.788509:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317919.684223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317919.813486:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317919.940310:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317919.940319:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317919.940322:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317919.940327:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317919.940331:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317919.940341:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3166 00000100:00080000:1.0:1767317919.940352:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317919.940358:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317919.940369:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317919.940416:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2680 x1853163894232704/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317919.940594:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894232832:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317919.940682:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894232704:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317919.969943:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317919.969961:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317919.969967:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894232704:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317919.971255:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894232832:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317920.708555:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317920.836693:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317921.732259:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317921.860671:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317922.756286:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317922.884433:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317923.780222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317923.910796:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317924.038389:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317899/real 1767317899] req@ffff9cfe0f3d0380 x1853163894231552/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317924 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317924.038428:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0380 x1853163894231552/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317924 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317924.038450:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317924.038477:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767317924.038482:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894231552:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317924.038577:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317924.038605:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317924.038609:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317924.038625:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3150 00000100:00080000:1.0:1767317924.038635:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317924.038642:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767317924.038675:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1c00 x1853163894232960/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767317924.038704:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317924.038708:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317924.038709:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317924.038714:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3171 00000100:00080000:1.0:1767317924.038717:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317924.038722:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317924.038732:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317924.038744:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0a80 x1853163894233088/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317924.038795:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894233216:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317924.039022:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894232960:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767317924.039058:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894233088:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317924.048365:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317924.048383:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317924.048389:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894233088:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317924.048585:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894233216:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317924.804242:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317924.932314:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317925.829276:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317925.956605:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317926.852258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317926.981149:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317927.876337:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317928.005610:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317928.900400:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317929.028650:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317929.156489:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317929.156500:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317929.156503:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317929.156507:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317929.156512:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317929.156524:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3175 00000100:00080000:0.0:1767317929.156544:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317929.156552:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317929.156573:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317929.156616:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8e00 x1853163894233344/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317929.156917:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894233344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317929.157340:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894233472:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317929.162774:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894233472:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317929.176141:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317929.176158:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317929.176163:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894233344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317929.925009:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317930.052360:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317930.948366:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317931.076386:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317931.972527:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317932.100358:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317933.001058:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317933.125350:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317934.020204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317934.148589:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317934.276377:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317934.276385:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317934.276387:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317934.276391:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317934.276395:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317934.276405:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3180 00000100:00080000:2.0:1767317934.276416:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317934.276423:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317934.276434:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317934.276468:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894233600/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317934.276773:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894233728:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317934.276927:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894233600:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317934.284855:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317934.284873:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317934.284880:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894233600:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317934.284899:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894233728:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317935.044342:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317935.172338:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317936.068238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317936.196757:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317937.093643:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317937.220382:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317938.116300:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317938.245390:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317939.140315:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317939.276060:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767317939.396922:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317939.396934:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767317939.396937:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767317939.396940:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767317939.396945:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767317939.396958:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3185 00000100:00080000:0.0:1767317939.396995:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767317939.397003:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767317939.397016:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767317939.397057:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8e00 x1853163894233856/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317939.397125:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894233856:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317939.397450:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894233984:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317939.404320:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894233984:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317939.406355:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317939.406383:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317939.406651:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894233856:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317940.164224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317940.295875:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317941.188236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317941.316614:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317942.212220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317942.340741:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317943.236668:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317943.364320:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317944.260233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317944.390987:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317944.517707:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317944.517720:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317944.517723:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317944.517745:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317944.517750:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317944.517759:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3190 00000100:00080000:2.0:1767317944.517770:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317944.517777:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317944.517788:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317944.517821:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894234112/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317944.517933:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894234240:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317944.517954:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894234112:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317944.535846:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317944.535864:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317944.535870:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894234112:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317944.536255:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894234240:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317945.286566:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317945.417211:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317946.311147:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317946.437161:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317947.332215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317947.460617:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317948.356711:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317948.484491:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317949.380378:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317949.509283:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767317949.636800:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317924/real 1767317924] req@ffff9cfe0f3d1c00 x1853163894232960/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317949 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767317949.636836:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d1c00 x1853163894232960/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317949 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767317949.636854:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317949.636862:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767317949.636866:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894232960:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317949.637061:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317949.637067:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317949.637070:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317949.637075:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3175 00000100:00080000:1.0:1767317949.637106:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317949.637113:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767317949.637144:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3b80 x1853163894234368/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767317949.637175:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317949.637178:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317949.637180:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317949.637183:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3195 00000100:00080000:1.0:1767317949.637186:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317949.637190:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317949.637199:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317949.637211:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1180 x1853163894234496/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317949.637247:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317949.637259:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894234624:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317949.637449:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894234368:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767317949.637504:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894234496:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317949.642826:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317949.642844:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317949.642849:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894234496:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317949.648075:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894234624:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317950.404279:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317950.534640:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317951.428254:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317951.557830:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317952.452243:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317952.582338:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317953.476287:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317953.607508:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317954.500258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317954.629498:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317954.756407:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317954.756420:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317954.756446:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317954.756451:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317954.756456:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317954.756467:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3200 00000100:00080000:2.0:1767317954.756479:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317954.756487:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317954.756500:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317954.756534:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894234752/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767317954.756598:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767317954.756613:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894234880:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317954.756780:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894234752:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317954.761401:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317954.761419:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317954.761424:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894234752:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767317954.762762:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894234880:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317955.524342:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317955.652867:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317956.548308:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317956.679470:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317957.572251:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317957.700435:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317958.596214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317958.725231:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317959.620201:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317959.748380:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317959.876297:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317959.876326:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317959.876329:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317959.876333:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317959.876337:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317959.876348:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3206 00000100:00080000:1.0:1767317959.876359:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317959.876366:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317959.876548:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317959.876591:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2a00 x1853163894235008/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317959.876660:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894235136:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767317959.876849:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894235008:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317959.882811:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894235136:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767317959.882918:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317959.882925:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317959.882929:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894235008:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317960.645524:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317960.776003:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317961.671856:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317961.796495:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317962.692213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317962.820391:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317963.716272:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317963.844654:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317964.742393:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317964.868512:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317964.996231:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317964.996259:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317964.996262:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317964.996265:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317964.996270:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317964.996281:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3211 00000100:00080000:1.0:1767317964.996292:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317964.996299:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317964.996327:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317964.996358:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2300 x1853163894235264/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317964.996459:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894235392:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767317964.997473:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894235264:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767317965.002795:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767317965.002813:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767317965.002819:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894235264:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317965.003010:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894235392:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317965.764340:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317965.892459:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317966.788216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317966.916328:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317967.812226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317967.940662:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317968.836257:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317968.964760:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317969.860256:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317969.989686:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317970.116288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317970.116300:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317970.116304:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317970.116307:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317970.116312:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317970.116323:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3216 00000100:00080000:1.0:1767317970.116333:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317970.116339:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317970.116352:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317970.116380:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3800 x1853163894235520/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317970.116432:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894235648:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317970.116770:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894235520:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317970.121404:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317970.121418:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317970.121424:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894235520:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317970.122225:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894235648:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317970.884211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317971.013166:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317971.908879:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317972.042552:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317972.933149:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317973.060812:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317973.956474:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317974.084544:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767317974.216461:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317949/real 1767317949] req@ffff9cfe0f3d3b80 x1853163894234368/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317974 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767317974.216496:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d3b80 x1853163894234368/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317974 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767317974.216516:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767317974.216544:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767317974.216549:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894234368:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767317974.220485:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317974.220496:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767317974.220500:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317974.220511:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3200 00000100:00080000:1.0:1767317974.220521:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317974.220529:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767317974.220581:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1f80 x1853163894235776/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767317974.220616:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317974.220620:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317974.220622:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317974.220626:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3221 00000100:00080000:1.0:1767317974.220631:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317974.220635:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317974.220644:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317974.220656:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2300 x1853163894235904/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317974.220719:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767317974.220737:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894236032:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317974.220974:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894235776:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767317974.221011:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894235904:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767317974.231350:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317974.231366:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317974.231390:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894235904:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317974.231671:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894236032:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317974.980493:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317975.108331:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317976.004184:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317976.132638:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317977.028471:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317977.156405:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317978.052314:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317978.180452:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317979.076478:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317979.204620:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317979.333389:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317979.333400:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317979.333403:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317979.333407:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317979.333411:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317979.333422:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3225 00000100:00080000:2.0:1767317979.333432:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317979.333439:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317979.333462:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317979.333496:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894236160/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767317979.333642:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894236288:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317979.335059:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894236160:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317979.338064:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894236288:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317979.340894:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317979.340910:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317979.340915:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894236160:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317980.100352:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317980.231961:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317981.128133:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317981.253619:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317982.148286:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317982.279237:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317983.172624:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767317983.301985:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317984.196209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317984.324777:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317984.452627:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317984.452638:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317984.452641:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317984.452646:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317984.452651:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317984.452662:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3230 00000100:00080000:2.0:1767317984.452673:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317984.452680:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317984.452709:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317984.452740:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894236416/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317984.457452:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894236416:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317984.460516:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894236544:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317984.462025:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317984.462037:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317984.462042:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894236416:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317984.468422:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894236544:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317985.220358:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317985.348298:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317986.244525:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317986.372445:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317987.268258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317987.397416:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317988.292214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317988.421459:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317989.316215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317989.444330:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767317989.572229:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317989.572244:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767317989.572247:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317989.572251:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317989.572257:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317989.572268:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3235 00000100:00080000:2.0:1767317989.572279:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317989.572287:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317989.572298:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317989.572334:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894236672/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317989.572406:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894236672:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317989.572844:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894236800:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767317989.578916:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894236800:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317989.578995:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317989.579077:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317989.579179:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894236672:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317990.340214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317990.468358:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317991.366188:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317991.492394:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317992.388243:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317992.516603:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317993.412625:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317993.540495:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317994.436234:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317994.564602:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767317994.692290:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317994.692302:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767317994.692305:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767317994.692309:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767317994.692313:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767317994.692324:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3240 00000100:00080000:1.0:1767317994.692336:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767317994.692344:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767317994.692375:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767317994.692412:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2a00 x1853163894236928/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767317994.692487:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894237056:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767317994.693163:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894236928:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767317994.711333:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894237056:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317994.713418:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317994.713434:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317994.713455:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894236928:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767317995.460243:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317995.588681:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317996.484249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317996.616720:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317997.511269:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317997.637724:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317998.532843:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317998.660304:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317999.556252:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767317999.684355:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767317999.812244:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317974/real 1767317974] req@ffff9cfe0f3d1f80 x1853163894235776/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317999 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767317999.812282:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d1f80 x1853163894235776/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767317999 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767317999.812302:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317999.812330:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767317999.812334:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894235776:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767317999.812506:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317999.812512:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767317999.812515:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317999.812521:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3225 00000100:00080000:2.0:1767317999.812530:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317999.812536:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767317999.812572:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894237184/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767317999.812602:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767317999.812622:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767317999.812624:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767317999.812628:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3246 00000100:00080000:2.0:1767317999.812633:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767317999.812637:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767317999.812648:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767317999.812660:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894237312/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767317999.812905:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894237184:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767317999.813014:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894237312:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317999.813601:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894237440:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767317999.837703:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767317999.837720:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767317999.837725:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894237312:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767317999.837962:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894237440:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318000.580254:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318000.708430:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318001.604293:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318001.732289:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318002.628478:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318002.756458:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318003.652323:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318003.780356:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318004.676230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318004.804966:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318004.932323:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318004.932423:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318004.932426:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318004.932430:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318004.932435:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318004.932445:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3251 00000100:00080000:2.0:1767318004.932455:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318004.932462:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318004.932474:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318004.932509:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894237568/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318004.932580:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318004.932592:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894237696:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318004.933997:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894237568:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318004.944801:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894237696:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318004.944949:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318004.944957:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318004.944961:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894237568:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318005.700237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318005.829043:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318006.724196:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318006.852442:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318007.749998:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318007.876690:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318008.772205:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318008.900509:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318009.796243:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318009.927252:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318010.052210:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318010.052221:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318010.052244:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318010.052248:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318010.052253:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318010.052263:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3256 00000100:00080000:2.0:1767318010.052274:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318010.052282:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318010.052293:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318010.052325:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894237824/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318010.052400:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318010.052414:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894237952:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318010.052419:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894237824:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318010.061155:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894237952:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318010.069729:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318010.069745:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318010.069751:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894237824:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318010.821247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318010.950762:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318011.844615:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318011.973064:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318012.868315:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318012.997642:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318013.892223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318014.020280:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318014.916224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318015.044383:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318015.172627:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318015.172637:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318015.172640:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318015.172644:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318015.172648:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318015.172658:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3261 00000100:00080000:1.0:1767318015.172668:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318015.172674:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318015.172684:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318015.172715:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1180 x1853163894238080/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318015.172775:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767318015.172799:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894238208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318015.173343:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894238080:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318015.193754:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318015.193775:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318015.193792:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894238080:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318015.194867:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894238208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318015.940278:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318016.069516:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318016.966296:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318017.092731:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318017.988273:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318018.116741:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318019.012221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318019.141803:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318020.036223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318020.164368:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318020.292264:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318020.292279:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318020.292309:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318020.292312:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318020.292317:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318020.292327:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3266 00000100:00080000:1.0:1767318020.292339:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318020.292348:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318020.292360:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318020.292399:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1c00 x1853163894238336/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318020.292475:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318020.292495:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894238464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318020.294542:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894238336:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767318020.318167:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318020.318181:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318020.318186:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894238336:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318020.322473:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894238464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318021.060256:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318021.188529:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318022.084674:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318022.216161:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318023.108204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318023.243936:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318024.140531:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318024.261272:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318024.388246:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317999/real 1767317999] req@ffff9cfe29109c00 x1853163894237184/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318024 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767318024.388371:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29109c00 x1853163894237184/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318024 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767318024.388838:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318024.389071:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767318024.389075:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894237184:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767318024.397909:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318024.397920:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318024.397925:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318024.397934:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3251 00000100:00080000:2.0:1767318024.397945:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318024.397953:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767318024.397994:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894238592/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767318024.398247:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318024.398251:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318024.398253:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318024.398257:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3271 00000100:00080000:2.0:1767318024.398262:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318024.398266:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318024.398851:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318024.398873:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894238720/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318024.398954:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894238848:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318024.399471:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894238592:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767318024.401098:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894238720:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318024.405375:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894238848:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318024.415589:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318024.415604:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318024.415622:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894238720:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318025.156348:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318025.292663:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318026.180164:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318026.310010:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318027.214227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318027.338115:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318028.228184:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318028.356313:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318029.258471:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318029.380328:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318029.509774:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318029.509788:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318029.509792:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318029.509796:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318029.509802:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318029.509812:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3275 00000100:00080000:3.0:1767318029.509825:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318029.509884:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318029.509896:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318029.509936:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4380 x1853163894238976/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318029.510024:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894239104:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318029.510355:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894238976:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318029.518740:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894239104:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318029.524636:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318029.524660:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318029.524665:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894238976:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318030.276191:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318030.407852:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318031.300166:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318031.428754:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318032.324327:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318032.453698:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318033.348158:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318033.477195:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318034.372731:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318034.500740:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318034.628330:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318034.628343:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318034.628347:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318034.628351:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318034.628355:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318034.628366:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3280 00000100:00080000:0.0:1767318034.628390:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318034.628398:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318034.628410:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318034.628449:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb800 x1853163894239232/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318034.629000:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894239232:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318034.629932:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894239360:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318034.633306:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318034.633322:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318034.633328:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894239232:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318034.634853:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894239360:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318035.396219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318035.524312:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318036.420411:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318036.548451:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318037.444211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318037.572334:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318038.469358:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318038.600866:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318039.492195:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318039.620299:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318039.748356:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318039.748367:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318039.748371:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318039.748375:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318039.748379:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318039.748390:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3285 00000100:00080000:3.0:1767318039.748401:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318039.748409:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318039.748420:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318039.748456:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6680 x1853163894239488/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318039.748535:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318039.748549:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894239616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318039.749221:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894239488:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318039.752906:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894239616:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318039.758947:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318039.758964:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318039.758969:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894239488:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318040.516207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318040.644603:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318041.540976:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318041.668267:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318042.564263:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318042.692591:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318043.588247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318043.716728:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318044.612297:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318044.740493:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318044.868305:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318044.868315:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318044.868318:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318044.868322:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318044.868326:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318044.868337:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3291 00000100:00080000:1.0:1767318044.868349:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1767318044.868357:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318044.868384:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318044.868417:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0a80 x1853163894239744/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318044.868489:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894239872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318044.868846:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894239744:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318044.872269:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894239872:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318044.874664:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318044.874678:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318044.874683:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894239744:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318045.636201:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318045.764365:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318046.660699:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318046.788763:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318047.684217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318047.812581:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318048.708520:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318048.836725:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318049.732675:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318049.860446:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318049.988824:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318024/real 1767318024] req@ffff9cfe29109f80 x1853163894238592/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318049 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318049.988857:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29109f80 x1853163894238592/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318049 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318049.988875:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318049.988898:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318049.988902:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894238592:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318049.990758:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318049.990771:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318049.990775:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318049.990784:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3275 00000100:00080000:1.0:1767318049.990795:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318049.990802:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318049.990839:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0380 x1853163894240000/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318049.990874:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318049.990877:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318049.990879:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318049.990884:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3296 00000100:00080000:1.0:1767318049.990888:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1767318049.990892:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318049.990901:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318049.990911:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2680 x1853163894240128/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318049.991341:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894240256:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318049.991707:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894240000:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767318049.991763:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894240128:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318050.013543:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894240256:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318050.014804:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318050.014817:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318050.014822:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894240128:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318050.756214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318050.884652:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318051.780260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318051.910250:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318052.804262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318052.932693:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318053.828703:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318053.956367:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318054.852247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318054.980796:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318055.109801:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318055.109816:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318055.109821:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318055.109826:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318055.109832:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318055.109847:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3301 00000100:00080000:1.0:1767318055.109864:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1767318055.109873:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318055.109888:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318055.109939:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3100 x1853163894240384/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318055.110034:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894240512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318055.110617:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894240384:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318055.114522:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318055.114544:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318055.114551:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894240384:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318055.116379:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894240512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318055.876260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318056.004469:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318056.900420:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318057.028486:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318057.924235:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318058.053608:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318058.948862:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318059.077494:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318059.972284:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318060.100987:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318060.228209:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318060.228220:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318060.228224:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318060.228228:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318060.228232:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318060.228242:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3306 00000100:00080000:1.0:1767318060.228253:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318060.228291:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318060.228302:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318060.228333:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2d80 x1853163894240640/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318060.228435:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894240768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318060.228584:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894240640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318060.232687:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894240768:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318060.232807:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318060.232815:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318060.232819:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894240640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318060.996209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318061.124379:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318062.022846:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318062.148510:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318063.044332:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318063.172371:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318064.068559:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318064.200992:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318065.092223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318065.221416:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318065.348619:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318065.348630:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318065.348633:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318065.348637:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318065.348641:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318065.348669:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3311 00000100:00080000:3.0:1767318065.348678:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318065.348685:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318065.348696:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318065.348725:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894240896/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318065.348938:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894241024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318065.349200:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894240896:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318065.353923:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894241024:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318065.353926:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318065.353955:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318065.353961:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894240896:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318066.116223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318066.244279:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318067.144824:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318067.268300:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318068.165589:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318068.292319:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318069.188785:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318069.320734:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318070.217596:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318070.341878:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318070.468710:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318070.468720:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318070.468723:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318070.468726:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318070.468731:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318070.468740:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3316 00000100:00080000:3.0:1767318070.468750:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318070.468757:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318070.468767:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318070.468802:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894241152/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318070.468872:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318070.468901:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894241280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318070.469227:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894241152:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318070.474009:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318070.474042:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318070.474049:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894241152:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318070.474883:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894241280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318071.241162:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318071.364729:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318072.260276:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318072.391140:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318073.284920:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318073.412443:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318074.308447:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318074.436407:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318074.564299:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318049/real 1767318049] req@ffff9cfe0f3d0380 x1853163894240000/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318074 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318074.564332:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0380 x1853163894240000/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318074 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318074.564352:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318074.564383:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318074.564387:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894240000:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767318074.564475:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318074.564481:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318074.564484:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318074.564489:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3301 00000100:00080000:2.0:1767318074.564498:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318074.564504:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767318074.564729:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894241408/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767318074.564755:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318074.564758:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318074.564760:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318074.564764:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3321 00000100:00080000:2.0:1767318074.564768:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318074.564772:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318074.564780:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318074.564792:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910a680 x1853163894241536/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318074.564870:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318074.564882:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894241664:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318074.565110:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894241408:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767318074.565147:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894241536:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318074.569539:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894241664:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318074.569649:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318074.569661:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318074.569665:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894241536:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318075.334168:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318075.468169:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318076.356321:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318076.484791:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318077.380257:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318077.508541:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318078.405543:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318078.532421:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318079.428552:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318079.556584:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318079.684299:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318079.684310:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318079.684314:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318079.684317:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318079.684322:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318079.684331:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3325 00000100:00080000:0.0:1767318079.684342:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318079.684348:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318079.684360:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318079.684395:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb480 x1853163894241792/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318079.684531:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894241792:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318079.684849:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894241920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318079.688271:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894241920:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318079.688271:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318079.688286:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318079.688292:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894241792:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318080.453117:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318080.580288:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318081.476236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318081.604412:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318082.526318:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318082.628445:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318083.588285:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318083.652833:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318084.612256:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318084.679654:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318084.807121:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318084.807130:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318084.807133:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318084.807137:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318084.807141:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318084.807160:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3331 00000100:00080000:2.0:1767318084.807171:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318084.807179:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318084.807191:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318084.807221:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894242048/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318084.807477:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894242176:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318084.808333:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894242048:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318084.814746:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894242176:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318084.814842:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318084.814848:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318084.814867:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894242048:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318085.636579:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318085.702591:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318086.660266:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318086.725178:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318087.684308:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318087.748353:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318088.708270:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318088.772775:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318089.732677:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318089.799424:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318089.924507:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318089.924517:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318089.924520:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318089.924524:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318089.924528:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318089.924537:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3336 00000100:00080000:3.0:1767318089.924547:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318089.924570:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318089.924581:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318089.924608:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894242304/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318089.924672:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318089.924685:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894242432:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318089.925015:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894242304:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318089.942364:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318089.942379:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318089.942384:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894242304:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318089.943182:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894242432:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318090.756262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318090.820513:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318091.780216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318091.845150:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318092.804206:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318092.869879:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318093.829377:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318093.892390:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318094.854487:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318094.916347:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318095.047215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318095.047226:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318095.047230:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318095.047234:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318095.047239:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318095.047249:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3341 00000100:00080000:3.0:1767318095.047259:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318095.047267:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318095.047278:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318095.047312:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894242560/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318095.047620:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894242688:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318095.048568:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894242560:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318095.049751:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894242688:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318095.071285:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318095.071455:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318095.071462:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894242560:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318095.876850:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318095.940673:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318096.900267:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318096.964735:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318097.925304:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318097.989242:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318098.948376:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318099.012843:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318099.140264:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318074/real 1767318074] req@ffff9cfe29108a80 x1853163894241408/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318099 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318099.140300:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29108a80 x1853163894241408/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318099 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318099.140345:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318099.140433:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318099.140438:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894241408:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767318099.143878:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318099.143889:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318099.143893:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318099.143903:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3325 00000100:00080000:3.0:1767318099.143913:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318099.143920:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767318099.145838:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7100 x1853163894242816/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318099.145872:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318099.145876:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318099.145879:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318099.145883:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3346 00000100:00080000:3.0:1767318099.145891:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318099.145896:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318099.145906:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318099.145918:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894242944/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318099.146149:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894242816:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767318099.146603:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894242944:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318099.146722:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318099.146732:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894243072:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318099.154965:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894243072:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318099.167704:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318099.167721:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318099.167727:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894242944:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318099.972428:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318100.036683:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318100.996252:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318101.060377:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318102.020265:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318102.084324:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318103.044605:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318103.108367:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318104.068210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318104.134670:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318104.260213:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318104.260223:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318104.260226:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318104.260230:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318104.260235:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318104.260245:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3350 00000100:00080000:3.0:1767318104.260255:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318104.260263:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318104.260275:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318104.260309:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894243200/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318104.260385:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318104.260402:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894243328:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318104.260888:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894243200:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318104.269121:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894243328:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318104.269224:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318104.269232:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318104.269236:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894243200:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318105.092228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318105.156480:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318106.116238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318106.181411:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318107.140230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318107.206927:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318108.165422:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318108.228980:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318109.190337:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318109.252263:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318109.382137:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318109.382147:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318109.382150:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318109.382153:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318109.382158:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318109.382169:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3355 00000100:00080000:2.0:1767318109.382181:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318109.382187:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318109.382199:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318109.382235:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894243456/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318109.382317:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318109.382334:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894243584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318109.384877:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894243456:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318109.395590:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894243584:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318109.401853:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318109.401868:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318109.401873:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894243456:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318110.212217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318110.276347:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318111.236210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318111.304897:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318112.260220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318112.327522:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318113.284594:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318113.348616:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318114.308225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318114.372369:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318114.500493:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318114.500522:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318114.500525:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318114.500528:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318114.500532:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318114.500542:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3360 00000100:00080000:3.0:1767318114.500552:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318114.500559:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318114.500571:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318114.500606:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894243712/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318114.500675:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318114.500688:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894243840:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318114.501007:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894243712:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318114.507128:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894243840:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318114.558011:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318114.558034:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318114.558040:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894243712:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318115.332240:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318115.396426:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318116.356222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318116.423326:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318117.380232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318117.450129:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318118.404298:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318118.469145:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318119.429211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318119.493328:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318119.620426:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318119.620438:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318119.620441:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318119.620446:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318119.620450:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318119.620462:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3365 00000100:00080000:3.0:1767318119.620492:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318119.620500:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318119.620526:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318119.620566:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6d80 x1853163894243968/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318119.620641:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318119.620654:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894244096:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318119.620957:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894243968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318119.624472:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894244096:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318119.631134:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318119.631149:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318119.631155:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894243968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318120.452248:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318120.516288:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318121.476610:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318121.540379:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318122.500219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318122.564639:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318123.524215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318123.591448:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318124.548211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318124.612378:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318124.743286:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318099/real 1767318099] req@ffff9cfe18fd7100 x1853163894242816/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318124 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767318124.743323:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd7100 x1853163894242816/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318124 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767318124.743345:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318124.743354:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767318124.743359:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894242816:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318124.744980:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318124.744990:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318124.744993:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318124.745002:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3350 00000100:00080000:1.0:1767318124.745012:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318124.745019:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318124.745056:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1500 x1853163894244224/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318124.745141:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318124.745146:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318124.745148:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318124.745152:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3370 00000100:00080000:1.0:1767318124.745156:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318124.745160:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318124.745198:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318124.745213:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0700 x1853163894244352/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318124.745287:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767318124.745308:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894244480:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318124.749477:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894244224:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767318124.749616:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894244352:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318124.759885:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894244480:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318124.759927:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318124.759936:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318124.759949:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894244352:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318125.572314:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318125.637845:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318126.597290:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318126.662358:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318127.621286:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318127.685119:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318128.644621:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318128.708362:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318129.668594:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318129.734375:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318129.860471:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318129.860482:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318129.860484:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318129.860488:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318129.860493:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318129.860503:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3376 00000100:00080000:0.0:1767318129.860513:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318129.860519:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318129.860530:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318129.860564:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8a80 x1853163894244608/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318129.860646:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318129.860659:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894244736:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318129.860922:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894244608:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767318129.874613:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318129.874643:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318129.874648:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894244608:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318129.877159:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894244736:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318130.692318:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318130.760260:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318131.716220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318131.780325:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318132.740602:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318132.808147:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318133.764219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318133.836009:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318134.788229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318134.854157:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318134.980518:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318134.980538:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318134.980541:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318134.980546:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318134.980550:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318134.980561:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3381 00000100:00080000:0.0:1767318134.980571:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318134.980579:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318134.980591:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318134.980619:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9180 x1853163894244864/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318134.980681:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318134.980711:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894244992:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318134.980712:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894244864:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318134.990165:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318134.990179:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318134.990183:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894244864:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318134.992129:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894244992:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318135.812280:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318135.877396:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318136.836169:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318136.900294:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318137.860333:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318137.932342:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318138.884315:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318138.950696:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318139.908530:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318139.972810:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318140.100316:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318140.100329:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318140.100332:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318140.100336:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318140.100340:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318140.100351:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3386 00000100:00080000:0.0:1767318140.100382:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318140.100391:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318140.100421:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318140.100455:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089faa00 x1853163894245120/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318140.103525:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318140.103558:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894245248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318140.103784:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894245120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318140.107455:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894245248:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318140.107673:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318140.107690:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318140.107694:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894245120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318140.932228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318140.998155:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318141.956258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318142.020444:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318142.980282:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318143.044436:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318144.005214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318144.068665:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318145.031498:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318145.093789:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318145.220197:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318145.220207:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318145.220210:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318145.220214:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318145.220218:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318145.220229:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3391 00000100:00080000:0.0:1767318145.220240:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318145.220247:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318145.220257:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318145.220294:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894245376/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318145.220355:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894245376:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318145.220365:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318145.220374:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894245504:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318145.229773:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318145.229788:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318145.229793:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894245376:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318145.242312:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894245504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318146.052204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318146.116275:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318147.076318:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318147.144542:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318148.100754:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318148.166841:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318149.124196:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318149.191288:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318149.316313:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318124/real 1767318124] req@ffff9cfe0f3d1500 x1853163894244224/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318149 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767318149.316354:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d1500 x1853163894244224/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318149 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767318149.316374:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318149.316398:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767318149.316403:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894244224:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318149.316599:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318149.316604:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318149.316607:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318149.316613:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3376 00000100:00080000:1.0:1767318149.316622:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318149.316629:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318149.316657:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0000 x1853163894245632/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318149.316700:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318149.316704:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318149.316706:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318149.316710:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3396 00000100:00080000:1.0:1767318149.316714:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318149.316718:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318149.316726:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318149.316738:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3480 x1853163894245760/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318149.316892:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318149.316905:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894245888:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318149.319647:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894245632:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767318149.319735:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894245760:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318149.324521:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894245888:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318149.324874:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318149.324881:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318149.324885:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894245760:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318150.148227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318150.212386:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318151.172348:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318151.236981:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318152.196578:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318152.260418:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318153.221674:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318153.285750:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318154.246579:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318154.311923:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318154.437472:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318154.437482:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318154.437485:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318154.437489:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318154.437493:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318154.437504:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3400 00000100:00080000:0.0:1767318154.437514:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318154.437531:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318154.437541:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318154.437575:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa300 x1853163894246016/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318154.437637:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318154.437651:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894246144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318154.438446:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894246016:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767318154.452493:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318154.452509:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318154.452514:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894246016:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318154.455676:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894246144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318155.268676:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318155.332552:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318156.292206:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318156.356696:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318157.316337:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318157.380841:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318158.340255:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318158.404648:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318159.364343:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318159.429730:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318159.557970:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318159.557980:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318159.557983:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318159.557988:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318159.557993:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318159.558002:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3405 00000100:00080000:3.0:1767318159.558014:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318159.558021:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318159.558034:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318159.558074:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7100 x1853163894246272/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318159.558288:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894246400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318159.559104:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894246272:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318159.566364:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318159.566406:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318159.566412:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894246272:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318159.566864:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894246400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318160.388792:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318160.452954:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318161.414536:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318161.477989:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318162.436794:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318162.502532:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318163.460259:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318163.527210:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318164.484811:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318164.548595:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318164.676244:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318164.676254:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318164.676265:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318164.676269:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318164.676274:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318164.676284:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3410 00000100:00080000:2.0:1767318164.676294:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318164.676301:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318164.676313:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318164.676359:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894246528/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318164.676419:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894246528:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318164.676435:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318164.676448:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894246656:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318164.695163:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894246656:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318164.695927:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318164.695937:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318164.695941:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894246528:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318165.508172:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318165.573137:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318166.532246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318166.596431:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318167.556339:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318167.620472:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318168.583109:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318168.645053:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318169.604271:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318169.671732:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318169.802147:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318169.802157:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318169.802160:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318169.802164:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318169.802168:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318169.802178:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3416 00000100:00080000:0.0:1767318169.802188:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318169.802195:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318169.802205:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318169.802253:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9c00 x1853163894246784/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318169.802352:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894246784:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318169.802519:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318169.802531:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894246912:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318169.807155:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894246912:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318169.807392:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318169.807400:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318169.807404:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894246784:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318170.628261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318170.692305:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318171.652289:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318171.716702:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318172.678047:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318172.740439:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318173.701110:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318173.770877:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318174.724207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318174.788325:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318174.916214:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318149/real 1767318149] req@ffff9cfe0f3d0000 x1853163894245632/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318174 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767318174.916248:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0000 x1853163894245632/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318174 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767318174.916263:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318174.916283:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767318174.916286:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894245632:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318174.916580:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318174.916584:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318174.916587:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318174.916591:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3400 00000100:00080000:1.0:1767318174.916599:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318174.916604:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318174.916629:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1880 x1853163894247040/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318174.916652:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318174.916654:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318174.916668:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318174.916671:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3421 00000100:00080000:1.0:1767318174.916674:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318174.916677:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318174.916683:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318174.916693:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0000 x1853163894247168/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318174.916729:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767318174.916739:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894247296:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318174.917420:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894247040:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767318174.917462:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894247168:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318174.925164:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894247296:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318174.925247:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318174.925252:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318174.925255:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894247168:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318175.748223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318175.812372:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318176.772604:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318176.836423:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318177.797224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318177.860595:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318178.820274:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318178.884391:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318179.845436:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318179.908727:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318180.036382:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318180.036398:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318180.036401:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318180.036407:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318180.036413:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318180.036426:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3426 00000100:00080000:2.0:1767318180.036441:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318180.036449:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318180.036463:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318180.036513:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894247424/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318180.036606:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894247552:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318180.037278:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894247424:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318180.041176:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1767318180.041186:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894247552:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318180.041192:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318180.041200:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894247424:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318180.868229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318180.932335:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318181.892446:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318181.956412:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318182.084396:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894247680:192.168.202.121@tcp:17:kworker.0 00000100:00100000:1.0:1767318182.088981:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894247680:192.168.202.121@tcp:17:kworker.0 00000100:00100000:2.0:1767318182.916448:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318182.981657:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318183.941012:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318184.008698:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318184.964269:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318185.028437:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318185.157683:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318185.157697:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318185.157701:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318185.157705:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318185.157710:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318185.157731:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3431 00000100:00080000:2.0:1767318185.157744:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318185.157753:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318185.157769:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318185.157807:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894247808/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318185.157873:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318185.157894:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894247936:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318185.158196:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894247808:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318185.167518:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894247936:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318185.167547:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318185.167563:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318185.167571:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894247808:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318185.989023:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318186.052401:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318187.013529:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318187.076866:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318188.036263:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318188.106357:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318189.065048:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318189.126532:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318190.084458:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318190.148632:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318190.277580:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318190.277592:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318190.277596:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318190.277601:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318190.277605:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318190.277618:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3436 00000100:00080000:3.0:1767318190.277632:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318190.277640:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318190.277654:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318190.277697:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894248064/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318190.281715:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894248192:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318190.282298:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894248064:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318190.299561:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318190.303148:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318190.303160:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894248064:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318190.304162:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894248192:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318191.109899:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318191.173183:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318192.132297:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318192.199049:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318193.156200:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318193.220291:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318194.180225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318194.244475:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318195.204248:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318195.268350:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318195.397541:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318195.397550:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318195.397569:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318195.397573:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318195.397577:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318195.397587:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3441 00000100:00080000:0.0:1767318195.397598:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318195.397605:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318195.397616:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318195.397646:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fbb80 x1853163894248320/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318195.397732:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894248448:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318195.399031:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894248320:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318195.402775:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894248448:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318195.414850:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318195.414866:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318195.415131:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894248320:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318196.228230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318196.297811:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318197.252329:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318197.316861:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318198.276542:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318198.359863:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318199.300361:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318199.365170:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318199.493422:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318174/real 1767318174] req@ffff9cfe0f3d1880 x1853163894247040/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318199 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318199.493458:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d1880 x1853163894247040/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318199 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318199.493489:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318199.495784:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318199.495795:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894247040:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767318199.495856:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318199.495867:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318199.495870:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318199.495875:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3426 00000100:00080000:2.0:1767318199.495885:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318199.495891:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767318199.496018:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894248576/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318199.496077:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894248576:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767318199.496323:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318199.496328:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318199.496330:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318199.496335:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3446 00000100:00080000:2.0:1767318199.496340:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318199.496344:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318199.496353:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318199.496368:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894248704/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318199.496415:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894248832:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318199.496696:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894248704:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318199.500700:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894248832:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318199.505728:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318199.505745:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318199.505751:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894248704:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318200.324231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318200.388321:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318201.348278:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318201.413162:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318202.372227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318202.436416:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318203.396219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318203.460390:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318204.420214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318204.485805:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318204.612170:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318204.612180:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318204.612184:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318204.612188:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318204.612192:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318204.612201:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3450 00000100:00080000:2.0:1767318204.612211:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318204.612219:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318204.612229:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318204.612265:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894248960/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318204.612349:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318204.612366:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894249088:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318204.612658:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894248960:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318204.617286:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894249088:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318204.619414:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318204.619427:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318204.619432:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894248960:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318205.444328:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318205.508690:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318206.469323:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318206.532310:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318207.492974:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318207.556455:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318208.516193:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318208.582391:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318209.541342:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318209.604413:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318209.732704:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318209.732714:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318209.732717:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318209.732736:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318209.732739:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318209.732748:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3455 00000100:00080000:2.0:1767318209.733003:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318209.733012:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318209.733049:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318209.733099:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894249216/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318209.733197:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894249344:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318209.735306:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894249216:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318209.750494:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894249344:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318209.750676:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318209.750683:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318209.750687:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894249216:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318210.565057:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318210.628331:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318211.595475:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318211.653121:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318212.612231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318212.678448:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318213.636249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318213.702954:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318214.660756:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318214.725863:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318214.856234:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318214.856245:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318214.856249:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318214.856253:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318214.856257:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318214.856267:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3461 00000100:00080000:2.0:1767318214.856279:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318214.856287:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318214.856298:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318214.856333:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894249472/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318214.856439:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894249600:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318214.857113:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894249472:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318214.858823:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894249600:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318214.860182:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318214.860193:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318214.860199:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894249472:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318215.684248:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318215.748397:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318216.708216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318216.772495:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318217.735635:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318217.797468:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318218.756577:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318218.822630:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318219.780262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318219.844430:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318219.972474:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318219.972483:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318219.972486:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318219.972489:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318219.972494:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318219.972504:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3466 00000100:00080000:1.0:1767318219.972515:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318219.972522:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318219.972534:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318219.972570:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3480 x1853163894249728/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318219.972651:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894249856:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318219.973299:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894249728:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318219.977001:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894249856:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318219.977532:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318219.977540:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318219.977544:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894249728:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318220.804202:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318220.868362:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318221.828297:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318221.892682:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318222.852205:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318222.916366:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318223.876544:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318223.940512:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318224.068377:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318199/real 1767318199] req@ffff9cfe29108e00 x1853163894248576/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318224 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318224.068412:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29108e00 x1853163894248576/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318224 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318224.068433:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318224.068466:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318224.068470:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894248576:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318224.068701:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318224.068715:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318224.068719:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318224.068724:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3450 00000100:00080000:1.0:1767318224.068733:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318224.068739:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318224.068772:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1500 x1853163894249984/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318224.068819:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318224.068822:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318224.068824:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318224.068829:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3471 00000100:00080000:1.0:1767318224.068833:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318224.068837:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318224.068846:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318224.068868:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0700 x1853163894250112/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318224.068947:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894250240:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318224.069246:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894249984:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767318224.069279:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894250112:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318224.075580:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318224.075593:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318224.075598:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894250112:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318224.075674:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894250240:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318224.900513:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318224.964456:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318225.924297:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318225.990636:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318226.950199:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318227.013068:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318227.972517:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318228.036618:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318228.996956:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318229.060727:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318229.188585:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318229.188595:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318229.188598:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318229.188602:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318229.188607:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318229.188619:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3475 00000100:00080000:0.0:1767318229.188630:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318229.188637:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318229.188650:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318229.188686:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa680 x1853163894250368/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318229.188806:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894250368:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318229.188972:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894250496:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318229.193572:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318229.193590:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318229.193595:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894250368:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318229.194022:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894250496:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318230.020283:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318230.084547:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318231.044352:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318231.109216:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318232.068658:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318232.132531:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318233.092914:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318233.156399:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318234.118130:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318234.180408:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318234.308662:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318234.308672:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318234.308675:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318234.308691:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318234.308696:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318234.308706:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3480 00000100:00080000:0.0:1767318234.308718:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318234.308725:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318234.308735:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318234.308765:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa680 x1853163894250624/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318234.309499:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894250752:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318234.309623:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894250624:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318234.314322:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318234.314339:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318234.314345:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894250624:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318234.314446:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894250752:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318235.140181:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318235.207212:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318236.164966:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318236.229042:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318237.188228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318237.255516:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318238.212518:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318238.278288:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318239.236175:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318239.302316:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318239.434481:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318239.434515:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318239.434518:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318239.434522:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318239.434526:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318239.434536:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3485 00000100:00080000:1.0:1767318239.434545:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318239.434551:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318239.434561:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318239.434596:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0e00 x1853163894250880/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318239.434697:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894250880:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318239.434832:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894251008:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318239.447590:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894251008:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318239.447885:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318239.447893:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318239.447897:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894250880:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318240.260848:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318240.324977:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318241.284709:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318241.348450:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318242.308482:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318242.372494:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318243.332204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318243.396543:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318244.358955:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318244.422015:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318244.548884:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318244.548895:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318244.548899:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318244.548902:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318244.548907:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318244.548917:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3490 00000100:00080000:0.0:1767318244.548929:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318244.548936:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318244.548947:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318244.548982:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa680 x1853163894251136/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318244.549048:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894251264:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318244.549258:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894251136:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318244.565100:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318244.565119:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318244.565125:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894251136:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318244.565230:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894251264:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318245.380208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318245.445759:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318246.404244:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318246.468396:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318247.428310:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318247.492815:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318248.452208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318248.517739:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318249.476217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318249.540379:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318249.669379:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318224/real 1767318224] req@ffff9cfe0f3d1500 x1853163894249984/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318249 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318249.669421:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d1500 x1853163894249984/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318249 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318249.669442:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318249.669449:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318249.669453:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894249984:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767318249.669684:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318249.669690:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318249.669694:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318249.669699:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3475 00000100:00080000:2.0:1767318249.669710:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318249.669716:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767318249.669746:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894251392/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767318249.669770:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318249.669774:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318249.669776:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318249.669780:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3495 00000100:00080000:2.0:1767318249.669783:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318249.669787:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318249.669796:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318249.669806:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894251520/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318249.669865:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318249.669878:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894251648:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318249.670983:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894251392:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767318249.671056:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894251520:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318249.679773:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318249.679790:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318249.679796:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894251520:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318249.679919:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894251648:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318250.502787:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318250.565867:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318251.525052:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318251.588679:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318252.548212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318252.614522:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318253.572671:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318253.637108:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318254.596254:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318254.661556:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318254.788315:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318254.788325:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318254.788328:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318254.788332:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318254.788343:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318254.788354:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3501 00000100:00080000:1.0:1767318254.788364:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318254.788386:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318254.788408:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318254.788437:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0380 x1853163894251776/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318254.788503:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894251904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318254.788511:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894251776:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318254.794154:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318254.794170:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318254.794176:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894251776:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318254.794257:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894251904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318255.620232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318255.684434:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318256.644671:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318256.708485:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318257.668195:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318257.733210:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318258.694076:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318258.756669:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318259.716253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318259.785065:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318259.909157:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318259.909172:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318259.909175:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318259.909179:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318259.909184:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318259.909194:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3506 00000100:00080000:1.0:1767318259.909206:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318259.909213:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318259.909224:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318259.909262:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2d80 x1853163894252032/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318259.909338:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767318259.909353:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894252160:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318259.910136:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894252032:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318259.932191:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318259.932218:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318259.932224:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894252032:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318259.938732:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894252160:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318260.740252:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318260.804578:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318261.764914:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318261.828312:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318262.788207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318262.852914:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318263.812346:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318263.877593:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318264.836221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318264.901590:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318265.028459:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318265.028471:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318265.028474:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318265.028478:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318265.028482:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318265.028492:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3511 00000100:00080000:3.0:1767318265.028504:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318265.028520:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318265.028552:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318265.028591:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894252288/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318265.028669:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318265.028682:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894252416:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318265.029248:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894252288:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318265.032886:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894252416:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318265.032991:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318265.032997:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318265.033001:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894252288:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318265.861119:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318265.926901:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318266.884220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318266.948318:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318267.908454:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318267.972350:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318268.932675:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318268.996643:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318269.956164:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318270.020410:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318270.148288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318270.148344:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318270.148347:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318270.148350:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318270.148354:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318270.148365:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3516 00000100:00080000:3.0:1767318270.148376:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318270.148383:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318270.148395:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318270.148428:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894252544/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318270.148503:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894252544:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318270.148730:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894252672:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318270.155945:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318270.155960:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318270.155965:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894252544:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318270.160382:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894252672:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318270.980229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318271.044530:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318272.004224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318272.068390:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318273.028821:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318273.095344:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318274.054405:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318274.116378:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318274.246817:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318249/real 1767318249] req@ffff9cfe29108380 x1853163894251392/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318274 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318274.246851:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29108380 x1853163894251392/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318274 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318274.246869:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318274.246897:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318274.246901:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894251392:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318274.246998:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318274.247018:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318274.247020:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318274.247026:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3501 00000100:00080000:1.0:1767318274.247035:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318274.247040:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318274.247067:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3100 x1853163894252800/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318274.247113:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318274.247117:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318274.247119:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318274.247123:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3521 00000100:00080000:1.0:1767318274.247126:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318274.247130:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318274.247139:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318274.247159:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2680 x1853163894252928/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318274.247206:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894253056:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318274.247464:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894252800:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767318274.247497:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894252928:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318274.262781:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894253056:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318274.262885:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318274.262902:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318274.262906:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894252928:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318275.077560:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318275.144255:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318276.100218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318276.166281:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318277.125142:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318277.188300:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318278.148201:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318278.212421:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318279.172200:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318279.240872:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318279.364349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318279.364360:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318279.364363:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318279.364368:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318279.364372:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318279.364396:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3525 00000100:00080000:0.0:1767318279.364407:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318279.364415:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318279.364427:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318279.364463:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8380 x1853163894253184/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318279.364592:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894253184:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318279.364805:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894253312:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318279.371505:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894253312:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318279.376358:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318279.376375:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318279.376381:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894253184:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318280.196538:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318280.261002:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318281.220310:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318281.284220:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318282.244834:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318282.308635:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318283.268765:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318283.332443:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318284.292199:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318284.356620:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318284.484327:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318284.484348:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318284.484351:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318284.484354:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318284.484376:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318284.484385:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3530 00000100:00080000:0.0:1767318284.484396:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318284.484402:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318284.484413:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318284.484445:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fbb80 x1853163894253440/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318284.484569:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894253440:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318284.484757:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318284.484767:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894253568:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318284.496429:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318284.496446:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318284.496452:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894253440:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318284.496671:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894253568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318285.316573:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318285.380664:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318286.343462:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318286.404880:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318287.364453:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318287.428487:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318288.389866:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318288.454716:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318289.412227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318289.476742:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318289.604498:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318289.604508:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318289.604512:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318289.604515:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318289.604519:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318289.604529:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3535 00000100:00080000:2.0:1767318289.604539:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318289.604546:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318289.604557:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318289.604587:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894253696/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318289.604642:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318289.604657:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894253824:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318289.604897:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894253696:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318289.610910:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318289.610925:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318289.610931:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894253696:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318289.613644:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894253824:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318290.436218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318290.500648:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318291.460309:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318291.524342:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318292.484287:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318292.548377:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318293.508188:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318293.572432:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318294.532727:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318294.598371:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318294.726294:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318294.726304:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318294.726307:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318294.726324:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318294.726339:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318294.726349:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3540 00000100:00080000:3.0:1767318294.726367:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318294.726375:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318294.726386:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318294.726426:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894253952/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318294.726496:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894254080:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318294.726572:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894253952:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318294.733047:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318294.733069:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318294.733075:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894253952:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318294.733164:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894254080:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318295.556664:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318295.623459:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318296.580322:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318296.644473:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318297.604454:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318297.668361:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318298.628358:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318298.692542:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318299.652193:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318299.716346:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318299.844330:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318299.844340:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318299.844343:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318299.844346:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318299.844351:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318299.844361:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3546 00000100:00080000:3.0:1767318299.844372:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318299.844379:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318299.844392:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318299.844437:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894254208/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318299.844634:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894254336:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318299.845205:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318274/real 1767318274] req@ffff9cfe0f3d3100 x1853163894252800/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318299 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767318299.845229:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d3100 x1853163894252800/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318299 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767318299.845244:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894254208:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767318299.845292:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318299.845304:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767318299.845308:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894252800:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318299.845439:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318299.845444:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318299.845447:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318299.845451:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3525 00000100:00080000:1.0:1767318299.845457:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318299.845462:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318299.845481:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0a80 x1853163894254464/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318299.845827:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894254464:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767318299.852382:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894254336:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318299.852482:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318299.852489:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318299.852493:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894254208:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318300.678459:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318300.740559:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318301.701526:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318301.768233:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318302.730893:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318302.788326:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318303.749482:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318303.812789:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318304.772384:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318304.836621:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318304.964798:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318304.965186:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318304.965190:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318304.965195:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318304.965199:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318304.965210:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3551 00000100:00080000:3.0:1767318304.965223:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318304.965231:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318304.965242:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318304.965279:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894254592/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318304.965389:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894254720:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318304.965554:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894254592:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318304.974620:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894254720:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318304.981054:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318304.981070:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318304.981075:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894254592:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318305.796553:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318305.868846:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318306.820255:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318306.895835:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318307.846260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318307.908300:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318308.868318:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318308.934953:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318309.895707:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318309.957339:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318310.084839:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318310.084850:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318310.084853:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318310.084857:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318310.084862:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318310.084872:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3556 00000100:00080000:0.0:1767318310.084885:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318310.084909:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318310.084922:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318310.084958:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa300 x1853163894254848/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318310.085042:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318310.085057:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894254976:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318310.085500:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894254848:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767318310.089517:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318310.089532:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318310.089537:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894254848:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318310.089698:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894254976:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318310.916900:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318310.980312:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318311.941075:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318312.005224:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318312.965383:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318313.028389:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318313.990223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318314.052454:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318315.012579:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318315.076395:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318315.205120:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318315.205130:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318315.205134:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318315.205137:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318315.205142:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318315.205153:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3561 00000100:00080000:1.0:1767318315.205164:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318315.205172:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318315.205185:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318315.205220:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1c00 x1853163894255104/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318315.205295:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318315.205312:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894255232:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318315.205927:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894255104:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767318315.212524:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318315.212539:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318315.212544:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894255104:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318315.214732:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894255232:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318316.036217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318316.100794:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318317.060254:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318317.129246:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318318.084219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318318.148455:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318319.108247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318319.172587:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318320.132212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318320.196676:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318320.325957:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318320.325968:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318320.325971:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318320.325975:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318320.325997:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318320.326007:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3566 00000100:00080000:1.0:1767318320.326027:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318320.326035:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318320.326048:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318320.326098:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1180 x1853163894255360/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318320.326233:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894255488:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318320.326422:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894255360:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318320.329262:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894255488:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318320.329808:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318320.329816:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318320.329820:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894255360:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318321.156266:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318321.221159:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318322.180225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318322.244747:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318323.204181:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318323.271777:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318324.229216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318324.292369:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318324.423283:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318299/real 1767318299] req@ffff9cfe0f3d0a80 x1853163894254464/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318324 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318324.423334:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0a80 x1853163894254464/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318324 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318324.423356:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318324.423383:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767318324.423387:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894254464:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767318324.423431:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318324.423438:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318324.423441:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318324.423448:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3551 00000100:00080000:3.0:1767318324.423457:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318324.423464:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767318324.423500:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6680 x1853163894255616/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318324.423580:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894255616:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767318324.424069:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318324.424075:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318324.424116:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318324.424120:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3571 00000100:00080000:3.0:1767318324.424125:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318324.424129:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318324.424138:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318324.424154:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4380 x1853163894255744/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318324.425162:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894255744:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318324.425887:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894255872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318324.439652:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894255872:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318324.439754:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318324.439761:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318324.439765:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894255744:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318325.252224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318325.317476:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318326.276336:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318326.340300:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318327.300203:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318327.364520:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318328.324211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318328.388752:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318329.348669:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318329.412244:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318329.540673:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318329.540695:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318329.540698:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318329.540702:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318329.540707:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318329.540717:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3575 00000100:00080000:3.0:1767318329.540728:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318329.540735:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318329.540745:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318329.540779:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894256000/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318329.540855:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318329.540885:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894256128:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318329.541283:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894256000:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318329.550816:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894256128:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318329.556767:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318329.556806:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318329.556811:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894256000:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318330.372226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318330.438887:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318331.396352:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318331.463013:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318332.423432:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318332.484679:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318333.444225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318333.508854:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318334.468229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318334.535380:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318334.662298:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318334.662309:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318334.662312:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318334.662316:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318334.662321:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318334.662331:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3580 00000100:00080000:3.0:1767318334.662343:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318334.662350:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318334.662361:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318334.662394:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894256256/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318334.662540:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318334.662560:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894256384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318334.662561:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894256256:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318334.677587:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894256384:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318334.677919:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318334.677927:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318334.677931:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894256256:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318335.492177:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318335.558380:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318336.516772:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318336.580347:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318337.540218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318337.606907:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318338.564217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318338.628568:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318339.588542:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318339.652466:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318339.781575:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318339.781586:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318339.781589:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318339.781592:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318339.781596:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318339.781623:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3586 00000100:00080000:0.0:1767318339.781634:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318339.781641:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318339.781652:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318339.781681:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894256512/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318339.781754:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894256512:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318339.781950:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894256640:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318339.791326:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894256640:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318339.791790:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318339.791798:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318339.791803:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894256512:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318340.612261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318340.676323:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318341.637323:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318341.705633:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318342.660334:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318342.724292:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318343.684218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318343.748429:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318344.709688:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318344.772939:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318344.900430:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318344.900440:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318344.900442:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318344.900446:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318344.900450:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318344.900459:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3591 00000100:00080000:3.0:1767318344.900470:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318344.900492:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318344.900504:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318344.900532:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894256768/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318344.900610:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894256896:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318344.902100:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894256768:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318344.903481:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894256896:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318344.908402:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318344.908416:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318344.908422:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894256768:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318345.733068:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318345.797864:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318346.756347:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318346.820822:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318347.780349:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318347.844381:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318348.804310:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318348.870113:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318349.828514:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318349.892229:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318350.020222:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318324/real 1767318324] req@ffff9cfe18fd6680 x1853163894255616/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318349 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318350.020223:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318350.020234:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318350.020249:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318350.020254:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318350.020258:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1767318350.020261:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd6680 x1853163894255616/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318349 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318350.020268:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3596 00000100:00080000:0.0:1767318350.020282:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318350.020286:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318350.020291:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00080000:2.0:1767318350.020304:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000008:00100000:0.0:1767318350.020305:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318350.020310:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894255616:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767318350.020352:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089faa00 x1853163894257024/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767318350.020433:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318350.020436:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318350.020438:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318350.020442:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3575 00000100:00080000:0.0:1767318350.020446:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318350.020450:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767318350.020463:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9180 x1853163894257280/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318350.020795:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894257024:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318350.020892:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894257280:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767318350.021055:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894257152:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318350.025399:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318350.025412:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318350.025417:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894257024:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318350.026557:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894257152:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318350.852732:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318350.918695:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318351.876224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318351.942488:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318352.900225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318352.964918:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318353.924936:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318353.990688:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318354.949071:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318355.012372:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318355.140231:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318355.140240:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318355.140243:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318355.140247:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318355.140251:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318355.140259:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3601 00000100:00080000:0.0:1767318355.140270:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318355.140276:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318355.140285:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318355.140313:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9f80 x1853163894257408/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318355.140411:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318355.140437:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894257536:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318355.140778:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894257408:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318355.151046:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894257536:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318355.152747:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318355.152760:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318355.152765:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894257408:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318355.977960:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318356.036450:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318356.996296:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318357.061579:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318358.021385:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318358.084536:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318359.045095:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318359.109279:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318360.068772:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318360.133278:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318360.265346:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318360.265357:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318360.265360:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318360.265372:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318360.265377:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318360.265387:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3606 00000100:00080000:1.0:1767318360.265397:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318360.265405:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318360.265418:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318360.265455:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0a80 x1853163894257664/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318360.265562:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767318360.265578:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894257792:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318360.265579:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894257664:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767318360.297032:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318360.297049:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318360.297055:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894257664:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318360.303175:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894257792:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318361.092195:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318361.158585:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318362.116223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318362.180227:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318363.140220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318363.204523:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318364.164203:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318364.230257:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318365.188207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318365.256867:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318365.380228:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318365.380237:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318365.380240:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318365.380244:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318365.380250:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318365.380260:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3611 00000100:00080000:0.0:1767318365.380271:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318365.380278:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318365.380289:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318365.380326:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8a80 x1853163894257920/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318365.380413:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894257920:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318365.380414:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318365.380431:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894258048:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318365.388140:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318365.388156:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318365.388161:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894257920:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318365.388465:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894258048:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318366.212260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318366.276712:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318367.236184:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318367.300398:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318368.260442:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318368.324836:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318369.285524:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318369.348744:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318370.308215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318370.373297:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318370.500614:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318370.500625:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318370.500629:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318370.500633:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318370.500637:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318370.500647:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3616 00000100:00080000:3.0:1767318370.500658:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318370.500684:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318370.500696:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318370.500727:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894258176/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318370.500799:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894258304:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318370.501182:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894258176:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318370.503892:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894258304:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318370.503985:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318370.504002:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318370.504006:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894258176:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318371.332401:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318371.396917:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318372.357633:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318372.422114:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318373.380219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318373.447443:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318374.404228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318374.469122:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318375.428308:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318375.492872:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318375.620234:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318350/real 1767318350] req@ffff9cfe089f9180 x1853163894257280/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318375 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318375.620270:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089f9180 x1853163894257280/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318375 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318375.620292:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318375.620324:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318375.620329:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894257280:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318375.620480:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318375.620485:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318375.620488:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318375.620494:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3601 00000100:00080000:1.0:1767318375.620503:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318375.620523:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318375.620556:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2a00 x1853163894258432/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318375.620583:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318375.620587:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318375.620589:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318375.620593:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3621 00000100:00080000:1.0:1767318375.620596:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318375.620600:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318375.620609:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318375.620620:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2300 x1853163894258560/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318375.620665:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767318375.620678:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894258688:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318375.620937:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894258432:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767318375.620971:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894258560:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318375.629167:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318375.629183:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318375.629188:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894258560:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318375.631331:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894258688:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318376.452206:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318376.517211:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318377.476210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318377.540634:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318378.500207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318378.567580:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318379.524463:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318379.590985:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318380.548186:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318380.614542:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318380.740333:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318380.740343:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318380.740345:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318380.740349:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318380.740353:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318380.740362:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3626 00000100:00080000:0.0:1767318380.740372:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318380.740396:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318380.740409:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318380.740454:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9180 x1853163894258816/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318380.740530:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318380.740550:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894258944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318380.740721:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894258816:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318380.743335:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894258944:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318380.743895:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318380.743902:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318380.743905:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894258816:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318381.572647:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318381.637812:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318382.596769:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318382.660500:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318383.620499:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318383.684734:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318384.645870:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318384.709616:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318385.671105:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318385.732476:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318385.860213:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318385.860224:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318385.860228:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318385.860232:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318385.860236:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318385.860247:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3632 00000100:00080000:3.0:1767318385.860258:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318385.860265:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318385.860277:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318385.860763:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894259072/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318385.860847:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894259072:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318385.861002:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318385.861012:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894259200:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318385.867489:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894259200:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318385.868638:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318385.868648:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318385.868666:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894259072:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318386.693155:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318386.756448:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318387.716222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318387.780724:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318388.740210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318388.804430:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318389.764258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318389.829489:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318390.791497:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318390.852424:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318390.981345:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318390.981356:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318390.981359:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318390.981363:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318390.981367:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318390.981406:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3637 00000100:00080000:2.0:1767318390.981417:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318390.981424:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318390.981435:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318390.981468:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894259328/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318390.981682:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318390.981701:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894259456:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318390.982409:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894259328:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318390.991609:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894259456:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318390.994881:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318390.994897:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318390.994902:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894259328:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318391.812532:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318391.876853:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318392.836210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318392.900281:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318393.860172:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318393.928726:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318394.889543:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318394.948481:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318395.908567:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318395.972953:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318396.101108:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318396.101118:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318396.101120:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318396.101124:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318396.101129:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318396.101138:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3642 00000100:00080000:2.0:1767318396.101148:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318396.101167:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318396.101179:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318396.101214:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894259584/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318396.101438:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894259584:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318396.101845:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894259712:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318396.108394:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318396.108419:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318396.108425:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894259584:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318396.109874:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894259712:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318396.932409:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318396.997423:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318397.958818:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318398.020323:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318398.980223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318399.044658:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318400.004200:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318400.072994:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318400.196257:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318375/real 1767318375] req@ffff9cfe0f3d2a00 x1853163894258432/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318400 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318400.196315:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d2a00 x1853163894258432/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318400 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318400.196336:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318400.199697:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767318400.199706:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894258432:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767318400.199786:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318400.199792:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318400.199796:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318400.199803:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3626 00000100:00080000:3.0:1767318400.199812:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318400.199818:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767318400.199851:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894259840/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318400.199881:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318400.199885:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318400.199899:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318400.199904:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3647 00000100:00080000:3.0:1767318400.199908:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318400.199912:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318400.199920:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318400.199931:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894259968/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318400.199995:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894260096:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318400.200550:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894259840:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767318400.201793:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894259968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318400.206150:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894260096:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318400.209483:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318400.209499:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318400.209518:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894259968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318401.028230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318401.092390:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318402.052207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318402.119947:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318403.076332:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318403.140475:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318404.100171:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318404.165043:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318405.124216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318405.189191:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318405.317437:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318405.317447:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318405.317450:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318405.317454:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318405.317458:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318405.317468:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3651 00000100:00080000:0.0:1767318405.317478:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318405.317485:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318405.317495:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318405.317525:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb480 x1853163894260224/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318405.317592:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894260352:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318405.317622:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894260224:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318405.327672:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894260352:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318405.327690:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318405.327699:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318405.327704:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894260224:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318406.148216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318406.214950:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318407.172278:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318407.237526:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318408.196324:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318408.260383:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318409.221607:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318409.286072:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318410.244229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318410.311018:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318410.436732:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318410.436744:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318410.436747:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318410.436751:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318410.436756:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318410.436765:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3656 00000100:00080000:0.0:1767318410.436777:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318410.436784:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318410.436796:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318410.436848:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9880 x1853163894260480/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318410.436958:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894260480:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318410.437119:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318410.437129:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894260608:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318410.444135:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318410.444150:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318410.444155:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894260480:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318410.444468:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894260608:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318411.269709:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318411.332582:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318412.292849:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318412.356629:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318413.316397:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318413.380528:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318414.340978:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318414.404841:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318415.364268:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318415.428778:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318415.556469:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318415.556479:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318415.556482:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318415.556485:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318415.556489:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318415.556500:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3661 00000100:00080000:0.0:1767318415.556511:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318415.556517:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318415.556528:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318415.556558:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb800 x1853163894260736/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318415.556765:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894260864:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318415.556882:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894260736:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318415.565514:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894260864:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318415.568556:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318415.568572:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318415.568577:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894260736:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318416.390231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318416.453346:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318417.413232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318417.476559:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318418.436255:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318418.503382:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318419.460968:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318419.524331:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318420.486308:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318420.550388:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318420.676579:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318420.676590:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318420.676592:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318420.676596:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318420.676600:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318420.676641:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3666 00000100:00080000:2.0:1767318420.676652:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318420.676659:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318420.676671:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318420.676704:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894260992/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318420.676761:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894260992:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318420.677052:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894261120:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318420.680487:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894261120:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318420.683779:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318420.683793:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318420.683799:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894260992:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318421.508253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318421.572440:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318422.532520:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318422.596953:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318423.556292:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318423.620374:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318424.580211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318424.644381:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318425.604193:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318425.669730:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318425.797165:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318400/real 1767318400] req@ffff9cfe18fd7b80 x1853163894259840/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318425 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318425.797198:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd7b80 x1853163894259840/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318425 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318425.797226:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318425.797236:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767318425.797239:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894259840:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767318425.797368:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318425.797374:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318425.797377:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318425.797382:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3651 00000100:00080000:3.0:1767318425.797391:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318425.797396:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767318425.797428:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894261248/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318425.797483:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318425.797486:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318425.797488:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318425.797492:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3672 00000100:00080000:3.0:1767318425.797496:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318425.797500:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318425.797509:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318425.797521:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894261376/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318425.797744:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894261504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318425.797963:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894261248:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767318425.797998:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894261376:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318425.803345:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318425.803363:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318425.803368:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894261376:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318425.803737:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894261504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318426.628471:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318426.693968:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318427.652296:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318427.722325:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318428.676236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318428.740351:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318429.700210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318429.765384:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318430.724312:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318430.789284:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318430.918904:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318430.918913:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318430.918916:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318430.918920:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318430.918925:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318430.918934:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3677 00000100:00080000:1.0:1767318430.918962:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318430.918969:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318430.918980:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318430.919024:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2a00 x1853163894261632/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318430.919104:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318430.919114:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894261760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318430.919115:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894261632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318430.933149:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894261760:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318430.933522:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318430.933529:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318430.933533:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894261632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318431.748509:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318431.812677:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318432.772766:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318432.837028:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318433.796279:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318433.860537:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318434.820217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318434.884957:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318435.844214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318435.908411:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318436.039518:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318436.039526:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318436.039528:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318436.039541:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318436.039545:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318436.039554:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3682 00000100:00080000:2.0:1767318436.039564:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318436.039571:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318436.039584:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318436.039616:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894261888/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318436.039682:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894262016:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318436.039943:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894261888:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318436.044950:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894262016:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318436.047888:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318436.047906:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318436.047911:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894261888:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318436.868356:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318436.933180:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318437.892386:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318437.956348:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318438.916212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318438.982102:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318439.940209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318440.005261:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318440.965492:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318441.028359:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318441.159325:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318441.159335:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318441.159338:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318441.159342:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318441.159346:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318441.159358:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3687 00000100:00080000:0.0:1767318441.159369:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318441.159377:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318441.159390:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318441.159426:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb100 x1853163894262144/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318441.159489:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318441.159505:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894262272:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318441.160190:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894262144:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318441.169002:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894262272:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318441.169131:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318441.169138:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318441.169142:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894262144:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318441.988259:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318442.062809:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318443.012492:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318443.076853:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318444.037478:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318444.100359:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318445.060499:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318445.124336:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318446.084213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318446.148308:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318446.277319:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318446.277329:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318446.277332:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318446.277336:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318446.277340:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318446.277351:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3692 00000100:00080000:1.0:1767318446.277363:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318446.277370:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318446.277382:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318446.277421:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3b80 x1853163894262400/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318446.277494:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318446.277510:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894262528:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318446.277535:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894262400:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767318446.286382:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318446.286397:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318446.286401:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894262400:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318446.286832:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894262528:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318447.108227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318447.173104:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318448.141973:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318448.196459:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318449.157033:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318449.220337:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318450.180229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318450.244298:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318450.372228:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318425/real 1767318425] req@ffff9cfe18fd5880 x1853163894261248/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318450 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767318450.372267:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd5880 x1853163894261248/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318450 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767318450.372288:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318450.372301:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767318450.372305:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894261248:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318450.372470:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318450.372476:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318450.372479:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318450.372484:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3677 00000100:00080000:1.0:1767318450.372492:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318450.372498:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318450.372524:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3800 x1853163894262656/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318450.372559:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318450.372563:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318450.372564:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318450.372568:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3697 00000100:00080000:1.0:1767318450.372573:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318450.372577:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318450.372586:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318450.372594:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894262656:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767318450.372601:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3b80 x1853163894262784/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318450.372653:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894262912:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318450.372698:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894262784:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318450.377315:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894262912:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318450.377484:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318450.377491:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318450.377495:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894262784:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318451.204416:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318451.268301:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318452.228217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318452.293254:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318453.252157:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318453.319788:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318454.276250:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318454.341127:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318455.300881:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318455.366470:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318455.492216:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318455.492227:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318455.492230:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318455.492254:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318455.492258:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318455.492268:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3701 00000100:00080000:1.0:1767318455.492279:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318455.492286:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318455.492297:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318455.492329:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2a00 x1853163894263040/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318455.492417:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318455.492437:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894263168:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318455.494225:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894263040:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318455.505500:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894263168:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318455.506042:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318455.506051:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318455.506056:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894263040:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318456.328762:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318456.389223:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318457.352489:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318457.416465:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318458.372282:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318458.436487:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318459.396308:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318459.460760:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318460.420860:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318460.488354:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318460.612939:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318460.612949:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318460.612952:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318460.612956:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318460.612960:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318460.612969:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3706 00000100:00080000:3.0:1767318460.612980:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318460.612988:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318460.612998:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318460.613037:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894263296/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318460.613175:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894263296:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318460.613461:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894263424:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318460.631067:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318460.631922:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318460.631930:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894263296:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318460.636356:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894263424:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318461.444431:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318461.508399:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318462.469038:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318462.535807:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318463.494138:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318463.557363:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318464.516209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318464.582111:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318465.540213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318465.604459:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318465.734029:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318465.734041:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318465.734044:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318465.734047:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318465.734052:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318465.734062:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3711 00000100:00080000:1.0:1767318465.734072:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318465.734103:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318465.734115:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318465.734152:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2300 x1853163894263552/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318465.734255:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767318465.734269:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894263680:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318465.735034:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894263552:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318465.751276:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894263680:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318465.756775:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318465.756791:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318465.756797:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894263552:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318466.564225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318466.628427:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318467.588209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318467.652348:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318468.612202:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318468.676840:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318469.636219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318469.700642:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318470.660916:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318470.725383:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318470.852876:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318470.852888:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318470.852891:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318470.852895:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318470.852899:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318470.852912:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3717 00000100:00080000:2.0:1767318470.852923:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318470.852931:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318470.852944:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318470.852984:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894263808/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318470.853046:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894263808:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318470.853253:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894263936:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318470.861928:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318470.861945:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318470.861951:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894263808:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318470.862177:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894263936:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318471.685423:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318471.748504:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318472.708225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318472.772368:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318473.732744:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318473.798216:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318474.758851:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318474.820650:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318475.781310:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318475.844382:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318475.972358:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318475.972371:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318475.972374:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318475.972379:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318475.972385:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318475.972398:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3722 00000100:00080000:1.0:1767318475.972412:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318475.972421:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318475.972434:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318475.972474:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0a80 x1853163894264064/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318475.972556:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894264192:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318475.972971:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318450/real 1767318450] req@ffff9cfe0f3d3800 x1853163894262656/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318475 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318475.973001:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d3800 x1853163894262656/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318475 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318475.973033:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894264064:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318475.973071:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318475.973097:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318475.973101:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894262656:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318475.973176:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318475.973180:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318475.973182:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318475.973186:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3701 00000100:00080000:1.0:1767318475.973191:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318475.973196:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318475.973217:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1f80 x1853163894264320/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318475.974719:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894264320:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767318475.985199:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894264192:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318475.985395:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318475.985402:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318475.985406:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894264064:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318476.804193:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318476.871762:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318477.829724:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318477.893112:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318478.852225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318478.916373:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318479.876235:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318479.940729:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318480.900285:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318480.965182:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318481.092395:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318481.092411:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318481.092414:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318481.092420:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318481.092424:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318481.092434:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3727 00000100:00080000:3.0:1767318481.092444:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318481.092451:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318481.092462:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318481.092496:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6d80 x1853163894264448/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318481.092639:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894264448:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318481.092826:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894264576:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318481.096938:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318481.096953:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318481.096960:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894264448:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318481.097122:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894264576:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318481.924221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318481.991049:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318482.948207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318483.012295:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318483.972224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318484.036988:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318484.996661:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318485.062205:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318486.020609:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318486.084267:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318486.212200:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318486.212211:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318486.212215:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318486.212244:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318486.212248:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318486.212259:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3732 00000100:00080000:3.0:1767318486.212275:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318486.212282:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318486.212292:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318486.212330:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894264704/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318486.212402:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318486.212415:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894264832:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318486.212417:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894264704:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318486.227690:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894264832:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318486.227744:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318486.227750:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318486.227753:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894264704:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318487.045028:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318487.108299:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318488.068630:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318488.132655:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318489.094514:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318489.164673:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318490.117010:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318490.181985:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318491.140333:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318491.204573:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318491.333700:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318491.333711:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318491.333715:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318491.333719:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318491.333723:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318491.333734:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3737 00000100:00080000:1.0:1767318491.333745:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318491.333752:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318491.333763:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318491.333800:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1180 x1853163894264960/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318491.333882:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894264960:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318491.334135:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894265088:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318491.341604:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894265088:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318491.344909:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318491.344942:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318491.344947:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894264960:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318492.164316:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318492.228983:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318493.188224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318493.255840:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318494.212317:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318494.276870:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318495.236411:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318495.300347:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318496.260208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318496.327166:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318496.454726:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318496.454735:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318496.454738:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318496.454741:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318496.454747:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318496.454759:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3742 00000100:00080000:2.0:1767318496.454770:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318496.454778:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318496.454790:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318496.454826:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894265216/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318496.454942:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318496.454962:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894265344:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318496.458755:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894265216:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318496.467631:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894265344:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318496.467762:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318496.467770:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318496.467775:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894265216:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318497.285751:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318497.348395:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318498.308536:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318498.374594:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318499.332271:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318499.397669:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318500.356230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318500.547372:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318500.548262:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318475/real 1767318475] req@ffff9cfe0f3d1f80 x1853163894264320/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318500 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767318500.548292:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d1f80 x1853163894264320/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318500 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767318500.548312:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318500.555754:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767318500.555769:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894264320:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318500.556057:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318500.556063:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318500.556067:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318500.556073:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3727 00000100:00080000:1.0:1767318500.556111:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318500.556119:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318500.556173:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1c00 x1853163894265472/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318500.556200:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318500.556203:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318500.556205:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318500.556210:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3747 00000100:00080000:1.0:1767318500.556214:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318500.556218:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318500.556226:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318500.556236:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3100 x1853163894265600/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318500.556280:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318500.556292:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894265728:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318500.556606:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894265472:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767318500.559054:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894265600:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318500.566353:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894265728:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318500.566492:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318500.566501:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318500.566505:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894265600:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318501.380218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318501.444499:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318502.407204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318502.470413:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318503.428268:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318503.492895:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318504.452334:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318504.516289:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318505.476255:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318505.540496:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318505.668841:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318505.668850:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318505.668853:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318505.668857:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318505.668860:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318505.668938:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3751 00000100:00080000:2.0:1767318505.668948:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318505.668955:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318505.668966:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318505.668998:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894265856/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318505.669069:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894265984:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318505.669152:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894265856:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318505.681528:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894265984:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318505.685696:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318505.685711:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318505.685716:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894265856:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318506.515485:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318506.565064:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318507.525292:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318507.588433:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318508.549250:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318508.612916:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318509.572582:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318509.637774:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318510.596195:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318510.661870:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318510.788396:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318510.788418:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318510.788421:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318510.788425:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318510.788429:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318510.788440:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3757 00000100:00080000:0.0:1767318510.788450:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318510.788456:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318510.788466:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318510.788504:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9500 x1853163894266112/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318510.788572:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318510.788592:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894266240:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318510.789239:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894266112:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318510.800335:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894266240:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318510.804926:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318510.804942:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318510.804948:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894266112:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318511.620620:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318511.685435:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318512.645100:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318512.708567:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318513.668246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318513.732464:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318514.692220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318514.756342:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318515.718466:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318515.780560:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318515.908320:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318515.908331:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318515.908334:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318515.908337:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318515.908342:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318515.908352:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3762 00000100:00080000:3.0:1767318515.908364:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318515.908371:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318515.908383:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318515.908421:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7100 x1853163894266368/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318515.908502:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894266368:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318515.908530:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318515.908545:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894266496:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318515.917534:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318515.917550:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318515.917556:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894266368:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318515.926336:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894266496:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318516.740210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318516.804691:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318517.764215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318517.828299:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318518.788250:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318518.855880:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318519.812265:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318519.876467:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318520.836466:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318520.901819:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318521.031802:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318521.031813:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318521.031816:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318521.031819:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318521.031824:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318521.031834:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3767 00000100:00080000:2.0:1767318521.031845:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318521.031852:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318521.031864:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318521.031898:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894266624/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318521.031973:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318521.032008:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894266752:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318521.034514:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894266624:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318521.037420:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894266752:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318521.039900:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318521.039917:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318521.039922:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894266624:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318521.860387:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318521.924592:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318522.885431:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318522.948452:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318523.911047:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318523.972782:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318524.932223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318525.002656:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318525.124323:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318500/real 1767318500] req@ffff9cfe0f3d1c00 x1853163894265472/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318525 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318525.124357:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d1c00 x1853163894265472/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318525 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318525.124375:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318525.124405:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318525.124409:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894265472:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767318525.124482:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318525.124488:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318525.124491:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318525.124497:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3751 00000100:00080000:3.0:1767318525.124506:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318525.124512:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767318525.124618:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6d80 x1853163894266880/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318525.124669:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894266880:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767318525.124781:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318525.124785:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318525.124786:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318525.124790:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3772 00000100:00080000:3.0:1767318525.124794:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318525.124798:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318525.124814:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318525.124827:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894267008/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318525.124898:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894267136:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318525.124972:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894267008:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318525.139452:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894267136:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318525.139476:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318525.139486:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318525.139504:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894267008:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318525.956304:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318526.020482:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318526.982275:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318527.046286:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318528.004342:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318528.068740:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318529.028224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318529.093453:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318530.052319:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318530.118407:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318530.244586:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318530.244598:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318530.244601:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318530.244605:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318530.244609:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318530.244621:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3776 00000100:00080000:2.0:1767318530.244632:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318530.244640:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318530.244652:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318530.244690:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894267264/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318530.244828:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894267264:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318530.245132:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894267392:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318530.248313:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318530.248333:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318530.248338:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894267264:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318530.254304:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894267392:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318531.079125:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318531.140494:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318532.100253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318532.164391:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318533.124202:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318533.192683:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318534.148228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318534.212251:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318535.172272:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318535.236842:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318535.366590:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318535.366601:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318535.366604:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318535.366607:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318535.367013:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318535.367024:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3781 00000100:00080000:2.0:1767318535.367034:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318535.367041:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318535.367053:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318535.367115:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894267520/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318535.367195:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894267520:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318535.368499:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894267648:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318535.377993:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318535.378011:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318535.378016:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894267520:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318535.382986:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894267648:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318536.196277:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318536.263064:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318537.220425:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318537.286646:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318538.244466:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318538.308736:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318539.268270:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318539.332620:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318540.292707:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318540.356484:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318540.484356:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318540.484364:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318540.484367:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318540.484370:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318540.484373:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318540.484380:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3786 00000100:00080000:0.0:1767318540.484568:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318540.484575:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318540.484584:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318540.484625:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb800 x1853163894267776/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318540.484675:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894267776:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318540.484987:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318540.484999:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894267904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318540.497182:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894267904:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318540.497587:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318540.497595:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318540.497599:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894267776:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318541.316673:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318541.381130:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318542.340272:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318542.408188:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318543.364207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318543.429622:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318544.388698:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318544.452603:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318545.412253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318545.476784:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318545.604403:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318545.604412:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318545.604415:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318545.604419:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318545.604423:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318545.604433:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3791 00000100:00080000:2.0:1767318545.604444:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318545.604451:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318545.604562:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318545.604604:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894268032/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318545.604884:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894268032:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318545.605061:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318545.605073:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894268160:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318545.615611:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318545.615627:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318545.615633:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894268032:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318545.622398:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894268160:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318546.436178:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318546.500401:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318547.463915:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318547.527206:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318548.484688:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318548.549442:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318549.508219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318549.583285:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318550.532169:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318550.602136:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318550.725515:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318550.725526:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318550.725529:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318550.725544:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318550.725549:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318550.725559:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3796 00000100:00080000:2.0:1767318550.725570:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318550.725578:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318550.725590:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318550.725636:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894268288/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318550.726113:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894268416:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318550.730745:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318525/real 1767318525] req@ffff9cfe18fd6d80 x1853163894266880/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318550 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318550.730782:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd6d80 x1853163894266880/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318550 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318550.730808:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894268288:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318550.730908:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318550.730964:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318550.730969:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894266880:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318550.735410:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318550.735420:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318550.735423:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318550.735433:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3776 00000100:00080000:1.0:1767318550.735442:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318550.735448:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318550.735483:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2680 x1853163894268544/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318550.736392:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894268544:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767318550.744768:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894268416:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318550.745464:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318550.745472:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318550.745476:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894268288:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318551.556786:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318551.620480:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318552.581942:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318552.644293:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318553.604217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318553.674414:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318554.628291:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318554.694407:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318555.653140:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318555.718960:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318555.844918:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318555.844925:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318555.844928:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318555.844931:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318555.844934:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318555.844941:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3802 00000100:00080000:0.0:1767318555.844949:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318555.844955:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318555.844964:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318555.844997:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8e00 x1853163894268672/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318555.845062:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318555.845076:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894268800:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318555.845353:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894268672:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318555.853305:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894268800:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318555.853406:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318555.853413:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318555.853417:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894268672:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318556.676999:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318556.744278:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318557.700982:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318557.765042:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318558.724751:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318558.788323:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318559.748371:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318559.812376:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318560.772788:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318560.845492:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318560.964264:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318560.964276:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318560.964279:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318560.964283:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318560.964287:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318560.964298:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3807 00000100:00080000:3.0:1767318560.964310:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318560.964317:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318560.964330:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318560.964365:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894268928/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318560.964453:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318560.964478:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894269056:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318560.964764:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894268928:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318560.972394:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318560.972409:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318560.972413:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894269056:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318560.972417:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894268928:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318561.796214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318561.861404:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318562.820842:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318562.884278:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318563.844197:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318563.909964:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318564.868891:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318564.936353:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318565.901792:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318565.959077:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318566.087209:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318566.087221:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318566.087224:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318566.087227:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318566.087231:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318566.087241:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3812 00000100:00080000:1.0:1767318566.087253:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318566.087259:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318566.087270:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318566.087303:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2d80 x1853163894269184/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318566.087374:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894269184:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318566.093093:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894269312:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318566.101691:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318566.101709:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318566.101715:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894269184:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318566.103321:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894269312:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318566.916587:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318566.981840:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318567.940214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318568.005534:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318568.968413:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318569.029291:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318569.988178:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318570.053528:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318571.013052:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318571.079409:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318571.204204:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318571.204214:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318571.204217:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318571.204221:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318571.204225:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318571.204236:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3817 00000100:00080000:3.0:1767318571.204245:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318571.204252:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318571.204264:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318571.204301:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894269440/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318571.204372:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894269568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318571.204954:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894269440:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318571.208769:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894269568:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318571.223649:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318571.223666:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318571.223672:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894269440:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318572.036356:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318572.100320:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318573.060214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318573.124383:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318574.086192:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318574.148305:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318575.108251:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318575.178125:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318575.301437:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318550/real 1767318550] req@ffff9cfe0f3d2680 x1853163894268544/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318575 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767318575.301483:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d2680 x1853163894268544/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318575 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767318575.301502:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318575.301532:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767318575.301536:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894268544:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767318575.302103:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318575.302109:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318575.302112:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318575.302117:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3802 00000100:00080000:0.0:1767318575.302126:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318575.302133:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767318575.302166:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8000 x1853163894269696/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767318575.302193:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318575.302196:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318575.302198:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318575.302201:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3822 00000100:00080000:0.0:1767318575.302205:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318575.302208:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318575.302231:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318575.302254:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9880 x1853163894269824/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318575.302340:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894269952:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318575.302489:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894269696:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767318575.302523:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894269824:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767318575.305631:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318575.305662:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318575.305667:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894269824:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318575.306409:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894269952:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318576.132629:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318576.196436:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318577.156472:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318577.220279:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318578.180296:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318578.244492:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318579.204223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318579.272200:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318580.228222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318580.293491:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318580.420177:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318580.420191:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318580.420195:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318580.420199:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318580.420203:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318580.420212:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3826 00000100:00080000:2.0:1767318580.420224:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318580.420232:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318580.420244:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318580.420283:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894270080/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318580.420348:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318580.420371:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894270208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318580.420808:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894270080:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318580.423048:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894270208:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318580.423222:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318580.423230:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318580.423235:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894270080:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318581.252284:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318581.316328:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318582.277796:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318582.340840:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318583.300777:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318583.364909:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318584.324482:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318584.388322:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318585.348284:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318585.414103:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318585.540777:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318585.540788:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318585.540791:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318585.540795:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318585.540799:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318585.540810:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3831 00000100:00080000:3.0:1767318585.540820:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318585.540828:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318585.540849:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318585.540898:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894270336/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318585.541186:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318585.541211:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894270464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318585.541503:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894270336:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318585.544817:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1767318585.544826:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894270464:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318585.544831:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318585.544835:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894270336:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318586.374132:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318586.436828:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318587.399292:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318587.463848:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318588.420989:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318588.484291:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318589.444191:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318589.508354:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318590.469409:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318590.532609:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318590.660222:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318590.660233:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318590.660253:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318590.660257:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318590.660261:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318590.660271:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3836 00000100:00080000:3.0:1767318590.660282:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318590.660289:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318590.660300:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318590.660335:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894270592/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318590.660416:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894270720:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318590.662435:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894270592:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318590.670419:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894270720:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318590.672800:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318590.672815:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318590.672821:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894270592:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318591.492923:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318591.557227:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318592.516395:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318592.580768:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318593.540863:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318593.604408:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318594.565263:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318594.631039:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318595.592825:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318595.652693:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318595.780338:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318595.780349:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318595.780352:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318595.780356:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318595.780360:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318595.780389:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3842 00000100:00080000:1.0:1767318595.780401:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318595.780407:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318595.780418:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318595.780452:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0380 x1853163894270848/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318595.780532:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894270976:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318595.782388:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894270848:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318595.784449:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894270976:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318595.788455:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318595.788472:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318595.788501:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894270848:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318596.612222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318596.677004:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318597.636342:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318597.700328:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318598.660231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318598.724543:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318599.684247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318599.750217:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318600.709102:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318600.773578:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318600.900702:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318600.900711:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318600.900714:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318600.900718:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318600.900722:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318600.900732:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3847 00000100:00080000:1.0:1767318600.900742:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1767318600.900748:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318575/real 1767318575] req@ffff9cfe089f8000 x1853163894269696/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318600 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318600.900749:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318600.900760:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318600.900773:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089f8000 x1853163894269696/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318600 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318600.900786:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1500 x1853163894271104/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767318600.900791:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318600.900802:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318600.900806:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894269696:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318600.900823:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318600.900826:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318600.900827:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1767318600.900835:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894271104:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318600.900847:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3826 00000100:00080000:1.0:1767318600.900851:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318600.900856:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318600.900867:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0700 x1853163894271360/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318600.900889:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894271232:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318600.901408:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894271360:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767318600.911394:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318600.911411:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318600.911416:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894271104:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318600.913167:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894271232:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318601.732351:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318601.797271:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318602.757838:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318602.827629:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318603.780251:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318603.848324:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318604.804227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318604.868629:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318605.830947:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318605.900481:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318606.020823:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318606.020840:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318606.020845:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318606.020850:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318606.020855:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318606.020891:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3852 00000100:00080000:0.0:1767318606.020917:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318606.020927:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318606.020945:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318606.020992:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8000 x1853163894271488/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318606.021068:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318606.021101:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894271616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318606.021108:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894271488:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767318606.034559:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318606.034581:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318606.034588:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894271488:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318606.047571:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894271616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318606.853122:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318606.925202:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318607.876229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318607.943564:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318608.900306:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318608.964625:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318609.924484:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318609.988311:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318610.948747:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318611.012312:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318611.140631:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318611.140642:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318611.140645:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318611.140649:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318611.140655:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318611.140667:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3857 00000100:00080000:3.0:1767318611.140678:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318611.140687:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318611.140702:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318611.140748:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894271744/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318611.140828:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894271872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318611.142273:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894271744:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318611.149348:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894271872:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318611.149448:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318611.149541:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318611.149562:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894271744:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318611.972204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318612.037131:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318612.996823:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318613.060364:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318614.020277:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318614.084821:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318615.044528:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318615.108603:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318616.068354:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318616.133012:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318616.260413:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318616.260426:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318616.260429:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318616.260433:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318616.260438:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318616.260451:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3862 00000100:00080000:2.0:1767318616.260467:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318616.260476:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318616.260489:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318616.260532:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894272000/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318616.260754:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894272000:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318616.261121:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894272128:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318616.272962:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318616.272982:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318616.272987:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894272000:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318616.273114:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894272128:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318617.092652:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318617.156907:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318618.116215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318618.180448:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318619.140238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318619.205729:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318620.164198:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318620.232318:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318621.189475:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318621.252652:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318621.380482:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318621.380492:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318621.380512:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318621.380516:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318621.380520:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318621.380530:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3867 00000100:00080000:3.0:1767318621.380542:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318621.380549:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318621.380559:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318621.380593:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894272256/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318621.380652:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894272256:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318621.380794:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318621.380804:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894272384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318621.387912:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894272384:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318621.388877:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318621.388900:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318621.388906:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894272256:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318622.213899:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318622.276463:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318623.237831:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318623.300439:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318624.260223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318624.324321:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318625.284238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318625.348352:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318625.476528:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318600/real 1767318600] req@ffff9cfe0f3d0700 x1853163894271360/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318625 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318625.476560:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0700 x1853163894271360/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318625 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318625.476579:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318625.476603:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318625.476628:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894271360:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767318625.476647:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318625.476655:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318625.476658:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318625.476665:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3852 00000100:00080000:2.0:1767318625.476673:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318625.476680:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767318625.476709:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894272512/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318625.476769:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894272512:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767318625.476920:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318625.476925:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318625.476927:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318625.476931:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3872 00000100:00080000:2.0:1767318625.476935:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318625.476939:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318625.476954:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318625.476965:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894272640/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318625.477155:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894272640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318625.477841:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894272768:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318625.484960:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318625.484979:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318625.484985:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894272640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318625.489608:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894272768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318626.308283:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318626.373944:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318627.332241:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318627.396330:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318628.356253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318628.423668:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318629.380316:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318629.444584:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318630.408716:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318630.472747:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318630.600228:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318630.600242:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318630.600245:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318630.600250:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318630.600255:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318630.600266:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3876 00000100:00080000:1.0:1767318630.600278:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318630.600285:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318630.600297:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318630.600344:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0e00 x1853163894272896/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318630.600428:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767318630.600449:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894273024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318630.600475:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894272896:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767318630.614450:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318630.614470:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318630.614477:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894272896:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318630.618394:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894273024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318631.428248:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318631.493936:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318632.452457:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318632.516510:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318633.476224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318633.543068:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318634.500358:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318634.564346:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318635.524398:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318635.588358:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318635.716193:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318635.716206:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318635.716209:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318635.716213:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318635.716218:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318635.716230:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3881 00000100:00080000:0.0:1767318635.716241:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318635.716249:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318635.716264:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318635.716306:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9180 x1853163894273152/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318635.716379:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318635.716397:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894273280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318635.716615:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894273152:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318635.719709:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894273280:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318635.719830:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318635.719838:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318635.719843:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894273152:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318636.548233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318636.612272:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318637.576306:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318637.637227:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318638.597950:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318638.662884:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318639.620276:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318639.685561:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318640.647036:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318640.708352:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318640.836476:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318640.836487:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318640.836490:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318640.836494:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318640.836499:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318640.836509:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3887 00000100:00080000:0.0:1767318640.836519:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318640.836525:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318640.836536:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318640.836572:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8a80 x1853163894273408/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318640.836654:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318640.836684:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894273536:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318640.837277:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894273408:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318640.847188:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894273536:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318640.847446:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318640.847454:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318640.847459:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894273408:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318641.668310:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318641.733511:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318642.692634:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318642.756330:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318643.716924:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318643.781024:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318644.740178:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318644.804216:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318645.764203:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318645.828506:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318645.956628:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318645.956638:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318645.956641:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318645.956645:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318645.956649:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318645.956659:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3892 00000100:00080000:0.0:1767318645.956689:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1767318645.956696:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318645.956708:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318645.956739:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9f80 x1853163894273664/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318645.956801:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894273792:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318645.957221:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894273664:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767318645.960839:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318645.960855:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318645.960861:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894273664:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318645.961000:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894273792:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318646.788583:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318646.853104:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318647.812477:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318647.878762:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318648.836336:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318648.900319:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318649.860435:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318649.925348:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318650.052294:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318625/real 1767318625] req@ffff9cfe29109c00 x1853163894272512/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318650 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318650.052342:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29109c00 x1853163894272512/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318650 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318650.052363:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318650.052386:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318650.052389:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894272512:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767318650.052480:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318650.052486:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318650.052489:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318650.052494:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3876 00000100:00080000:2.0:1767318650.052516:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318650.052526:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767318650.052568:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894273920/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767318650.052589:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318650.052591:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318650.052593:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318650.052595:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3897 00000100:00080000:2.0:1767318650.052600:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1767318650.052603:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318650.052612:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318650.052619:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894274048/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318650.052660:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318650.052687:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894274176:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318650.053247:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894273920:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767318650.053304:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894274048:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318650.055070:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894274176:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318650.055373:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318650.055380:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318650.055384:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894274048:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318650.885272:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318650.951879:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318651.908512:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318651.972642:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318652.932869:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318652.997232:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318653.958378:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318654.024725:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318654.980347:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318655.044375:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318655.173745:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318655.173777:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318655.173780:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318655.173785:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318655.173789:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318655.173799:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3901 00000100:00080000:1.0:1767318655.173810:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1767318655.173817:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318655.173827:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318655.173854:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3480 x1853163894274304/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318655.174304:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894274304:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318655.174544:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894274432:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318655.189901:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318655.189919:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318655.189925:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894274304:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318655.190037:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894274432:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318656.004709:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318656.068517:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318657.028210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318657.094273:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318658.053137:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318658.120291:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318659.076391:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318659.140416:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318660.100202:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318660.164279:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318660.295170:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318660.295180:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318660.295183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318660.295186:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318660.295208:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318660.295218:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3906 00000100:00080000:3.0:1767318660.295229:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318660.295235:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318660.295246:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318660.295279:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4380 x1853163894274560/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318660.295363:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318660.295371:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894274560:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318660.295376:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894274688:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318660.306826:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894274688:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318660.308850:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318660.308865:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318660.308870:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894274560:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318661.124311:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318661.188668:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318662.148333:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318662.212858:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318663.172225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318663.236809:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318664.198695:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318664.262324:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318665.220226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318665.285135:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318665.413241:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318665.413249:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318665.413252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318665.413256:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318665.413261:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318665.413272:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3911 00000100:00080000:0.0:1767318665.413291:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318665.413298:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318665.413308:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318665.413342:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089faa00 x1853163894274816/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318665.413447:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894274944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318665.413747:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894274816:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318665.427258:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894274944:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318665.427838:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318665.427846:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318665.427851:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894274816:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318666.244237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318666.309300:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318667.268515:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318667.337754:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318668.293059:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318668.357942:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318669.316228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318669.380351:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318670.340230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318670.404381:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318670.532379:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318670.532392:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318670.532396:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318670.532400:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318670.532405:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318670.532416:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3916 00000100:00080000:3.0:1767318670.532429:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318670.532437:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318670.532449:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318670.532487:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894275072/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318670.532571:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318670.532602:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894275200:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318670.532982:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894275072:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318670.536232:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318670.536249:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318670.536255:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894275072:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318670.536477:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894275200:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318671.365134:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318671.429070:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318672.389330:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318672.452613:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318673.412427:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318673.476319:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318674.437196:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318674.500500:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318675.460739:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318675.527829:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318675.652258:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318650/real 1767318650] req@ffff9cfe29108000 x1853163894273920/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318675 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318675.652293:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29108000 x1853163894273920/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318675 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318675.652313:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318675.652353:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767318675.652357:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894273920:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767318675.652731:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318675.652737:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318675.652740:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318675.652746:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3901 00000100:00080000:3.0:1767318675.652755:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318675.652762:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767318675.652798:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894275328/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318675.652824:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318675.652828:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318675.652830:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318675.652834:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3921 00000100:00080000:3.0:1767318675.652838:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318675.652842:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318675.652852:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318675.652863:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894275456/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318675.652928:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894275584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318675.653155:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894275328:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767318675.653201:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894275456:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318675.674113:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318675.674129:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318675.674144:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894275456:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318675.679252:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894275584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318676.484263:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318676.548658:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318677.508919:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318677.573364:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318678.532218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318678.596808:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318679.557332:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318679.622418:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318680.580215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318680.645778:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318680.772759:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318680.772771:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318680.772774:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318680.772777:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318680.772782:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318680.772792:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3927 00000100:00080000:2.0:1767318680.772801:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318680.772808:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318680.772829:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318680.772886:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894275712/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318680.773055:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894275712:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318680.773710:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318680.773724:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894275840:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318680.790895:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894275840:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318680.793586:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318680.793603:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318680.793608:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894275712:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318681.604287:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318681.668393:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318682.628837:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318682.694431:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318683.652972:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318683.720817:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318684.677678:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318684.741113:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318685.700371:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318685.766991:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318685.892645:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318685.892661:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318685.892664:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318685.892668:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318685.892675:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318685.892689:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3932 00000100:00080000:2.0:1767318685.892713:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318685.892723:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318685.892739:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318685.892790:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894275968/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318685.892896:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894276096:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318685.893527:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894275968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318685.897370:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894276096:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318685.897665:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318685.897673:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318685.897676:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894275968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318686.725293:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318686.788721:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318687.749009:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318687.812477:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318688.773262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318688.841511:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318689.796377:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318689.863172:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318690.820212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318690.884747:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318691.016766:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318691.016779:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318691.016783:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318691.016787:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318691.016792:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318691.016805:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3937 00000100:00080000:0.0:1767318691.016818:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318691.016825:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318691.016838:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318691.016878:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894276224/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318691.016950:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318691.016968:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894276352:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318691.019288:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894276224:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767318691.029558:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318691.029594:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318691.029600:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894276224:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318691.031367:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894276352:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318691.846184:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318691.910953:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318692.868448:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318692.932806:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318693.892279:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318693.956343:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318694.916667:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318694.982152:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318695.940334:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318696.004859:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318696.132770:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318696.132779:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318696.132782:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318696.132785:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318696.132788:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318696.132820:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3942 00000100:00080000:1.0:1767318696.132844:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318696.132851:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318696.132861:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318696.132897:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1880 x1853163894276480/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318696.132954:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767318696.132969:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894276608:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318696.135322:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894276480:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318696.147115:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894276608:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318696.147301:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318696.147308:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318696.147313:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894276480:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318696.964237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318697.028524:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318697.988269:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318698.053783:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318699.015040:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318699.076806:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318700.036280:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318700.102550:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318700.228760:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318675/real 1767318675] req@ffff9cfe18fd7800 x1853163894275328/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318700 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767318700.228819:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd7800 x1853163894275328/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318700 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767318700.228849:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318700.228939:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767318700.228944:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894275328:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318700.236793:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318700.236811:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318700.236818:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318700.236835:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3927 00000100:00080000:1.0:1767318700.236855:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318700.237656:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318700.237711:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0000 x1853163894276736/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318700.237753:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318700.237758:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318700.237760:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318700.237765:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3947 00000100:00080000:1.0:1767318700.237772:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318700.237777:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318700.237791:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318700.237806:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1880 x1853163894276864/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318700.238259:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894276992:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318700.238867:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894276736:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767318700.238923:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894276864:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767318700.242011:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318700.242027:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318700.242032:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894276864:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318700.242911:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894276992:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318701.061954:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318701.124466:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318702.084846:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318702.148924:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318703.112522:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318703.172943:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318704.132705:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318704.199192:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318705.158551:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318705.221575:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318705.353838:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318705.353852:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318705.353855:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318705.353858:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318705.353864:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318705.353877:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3951 00000100:00080000:0.0:1767318705.353891:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318705.353899:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318705.353914:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318705.353959:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9c00 x1853163894277120/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318705.354048:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318705.354066:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894277248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318705.355682:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894277120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318705.357422:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894277248:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318705.359353:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318705.359370:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318705.359375:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894277120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318706.180753:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318706.244424:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318707.206159:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318707.268361:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318708.229319:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318708.292385:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318709.252222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318709.316755:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318710.276288:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318710.348501:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318710.469219:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318710.469229:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318710.469232:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318710.469236:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318710.469241:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318710.469251:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3956 00000100:00080000:1.0:1767318710.469261:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318710.469268:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318710.469279:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318710.469314:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0e00 x1853163894277376/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318710.469412:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767318710.469428:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894277504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318710.470030:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894277376:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318710.472377:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894277504:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318710.482685:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318710.482701:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318710.482707:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894277376:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318711.300205:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318711.367324:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318712.324406:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318712.391570:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318713.348269:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318713.412719:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318714.372288:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318714.436459:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318715.397574:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318715.462476:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318715.588478:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318715.588487:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318715.588490:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318715.588494:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318715.588497:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318715.588508:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3961 00000100:00080000:3.0:1767318715.588531:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318715.588539:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318715.588552:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318715.588583:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894277632/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318715.588652:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894277632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318715.588799:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894277760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318715.608755:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894277760:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318715.641852:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318715.641869:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318715.641876:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894277632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318716.420432:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318716.484224:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318717.444198:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318717.508304:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318718.468789:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318718.532336:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318719.492271:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318719.557256:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318720.516886:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318720.580303:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318720.709106:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318720.709118:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318720.709121:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318720.709125:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318720.709129:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318720.709140:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3966 00000100:00080000:2.0:1767318720.709150:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318720.709157:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318720.709169:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318720.709202:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894277888/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318720.709271:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894278016:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318720.709275:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894277888:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318720.717632:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318720.717646:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318720.717651:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894277888:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318720.717677:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894278016:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318721.540232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318721.604377:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318722.564223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318722.628289:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318723.588564:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318723.652225:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318724.612295:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318724.677110:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318725.637116:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318725.700285:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318725.832676:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318725.832691:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318725.832694:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318725.832699:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318725.832704:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318725.832730:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3972 00000100:00080000:3.0:1767318725.832743:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318725.832752:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318725.832791:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318725.832836:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6680 x1853163894278144/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318725.832978:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894278272:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318725.837433:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894278272:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318725.838461:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318700/real 1767318700] req@ffff9cfe0f3d0000 x1853163894276736/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318725 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318725.838490:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0000 x1853163894276736/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318725 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318725.838512:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894278144:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318725.838661:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318725.838693:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318725.838699:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894276736:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767318725.840872:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318725.840881:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318725.840886:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318725.840896:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3951 00000100:00080000:2.0:1767318725.840905:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318725.840914:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767318725.840957:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894278400/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318725.841124:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894278400:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767318725.847840:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318725.847857:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318725.847862:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894278144:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318726.660749:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318726.724344:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318727.684228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318727.748300:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318728.712011:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318728.777555:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318729.732236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318729.797450:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318730.756985:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318730.820427:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318730.948255:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318730.948293:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318730.948296:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318730.948299:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318730.948304:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318730.948316:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3977 00000100:00080000:2.0:1767318730.948328:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318730.948335:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318730.948345:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318730.948382:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894278528/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318730.948442:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318730.948457:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894278656:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318730.948796:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894278528:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318730.953364:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318730.953382:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318730.953388:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894278528:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318730.958421:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894278656:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318731.785502:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318731.844670:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318732.804219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318732.868510:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318733.828264:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318733.892441:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318734.852240:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318734.919441:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318735.876216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318735.940417:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318736.068848:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318736.068860:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318736.068863:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318736.068866:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318736.068870:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318736.068880:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3982 00000100:00080000:1.0:1767318736.068890:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318736.068897:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318736.068908:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318736.068954:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0700 x1853163894278784/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318736.069023:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894278912:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318736.069412:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894278784:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318736.074442:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894278912:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318736.075939:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318736.075951:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318736.075956:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894278784:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318736.901862:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318736.967458:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318737.924234:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318737.988707:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318738.948282:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318739.012833:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318739.972210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318740.036440:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318740.996332:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318741.061326:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318741.191145:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318741.191155:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318741.191158:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318741.191162:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318741.191166:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318741.191175:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3987 00000100:00080000:2.0:1767318741.191231:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318741.191237:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318741.191248:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318741.191275:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894279040/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318741.191345:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894279168:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318741.191613:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894279040:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318741.196736:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894279168:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318741.197813:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318741.197824:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318741.197829:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894279040:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318742.020299:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318742.088320:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318743.044900:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318743.108435:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318744.068920:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318744.132974:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318745.095757:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318745.161446:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318746.117877:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318746.180360:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318746.308261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318746.308273:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318746.308276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318746.308280:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318746.308285:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318746.308300:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3992 00000100:00080000:2.0:1767318746.308313:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318746.308321:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318746.308336:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318746.308391:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894279296/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318746.308511:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894279424:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318746.308518:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894279296:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318746.317676:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894279424:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318746.325642:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318746.325659:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318746.325665:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894279296:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318747.140271:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318747.204361:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318748.164274:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318748.228860:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318749.188188:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318749.253211:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318750.213064:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318750.279265:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318750.404270:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318725/real 1767318725] req@ffff9cfe29109500 x1853163894278400/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318750 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318750.404306:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29109500 x1853163894278400/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318750 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318750.404350:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318750.404381:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318750.404386:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894278400:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767318750.404498:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318750.404504:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318750.404507:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318750.404513:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 3977 00000100:00080000:3.0:1767318750.404529:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318750.404535:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767318750.404564:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894279552/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318750.404592:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318750.404596:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318750.404598:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318750.404602:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 3997 00000100:00080000:3.0:1767318750.404605:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318750.404609:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318750.404619:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318750.404630:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894279680/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318750.404701:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318750.404714:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894279808:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318750.405197:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894279552:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767318750.405251:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894279680:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318750.414374:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318750.414391:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318750.414396:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894279680:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318750.414700:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894279808:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318751.236248:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318751.301662:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318752.260656:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318752.325359:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318753.284371:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318753.348598:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318754.308698:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318754.372759:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318755.332218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318755.397130:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318755.527413:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318755.527425:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318755.527429:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318755.527432:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318755.527436:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318755.527447:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4001 00000100:00080000:2.0:1767318755.527457:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318755.527464:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318755.527475:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318755.527523:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894279936/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318755.527589:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318755.527603:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894280064:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318755.527877:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894279936:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318755.533999:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318755.534014:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318755.534020:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894279936:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318755.534118:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894280064:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318756.356215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318756.422386:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318757.383491:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318757.444562:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318758.404898:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318758.469899:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318759.428215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318759.493126:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318760.452465:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318760.516369:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318760.645003:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318760.645025:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318760.645028:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318760.645033:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318760.645053:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318760.645065:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4006 00000100:00080000:3.0:1767318760.645076:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318760.645104:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318760.645117:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318760.645153:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894280192/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318760.645236:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894280192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318760.645803:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318760.645817:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894280320:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318760.648771:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318760.648786:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318760.648792:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894280192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318760.649715:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894280320:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318761.476221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318761.542841:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318762.500923:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318762.564437:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318763.524255:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318763.589751:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318763.652449:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318763.652460:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318763.652463:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318763.652468:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318763.652473:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318763.652482:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4011 00000100:00080000:0.0:1767318763.652494:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318763.652501:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318763.652512:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318763.652545:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fbb80 x1853163894280448/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318763.652724:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894280448:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318763.653621:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894280576:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318763.658117:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894280576:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318763.665166:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318763.665182:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318763.665187:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894280448:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318764.548226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318764.612373:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318765.574357:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318765.636396:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318766.596259:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318766.663090:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318767.620596:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318767.684611:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318768.644298:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318768.712846:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318768.836661:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318768.836674:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318768.836678:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318768.836682:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318768.836687:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318768.836696:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4015 00000100:00080000:2.0:1767318768.836706:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318768.836714:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318768.836726:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318768.837573:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894280704/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318768.837684:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894280832:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318768.837921:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894280704:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318768.844214:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894280832:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318768.846663:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318768.846682:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318768.846688:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894280704:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318769.668241:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318769.733198:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318770.693178:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318770.757958:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318771.716225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318771.780749:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318772.742071:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318772.805323:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318773.764241:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318773.829432:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318773.957431:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318773.957443:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318773.957446:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318773.957450:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318773.957455:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318773.957466:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4020 00000100:00080000:3.0:1767318773.957479:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318773.957486:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318773.957516:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318773.957549:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894280960/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318773.957679:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894281088:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318773.958361:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894280960:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318773.964815:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318773.964830:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318773.964835:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894280960:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318773.964957:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894281088:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318774.789321:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318774.852643:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318775.812265:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318775.876429:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318776.004224:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318750/real 1767318750] req@ffff9cfe18fd5c00 x1853163894279552/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318775 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318776.004256:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd5c00 x1853163894279552/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318775 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318776.004277:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318776.004308:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318776.004313:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894279552:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767318776.004427:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318776.004432:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318776.004435:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318776.004441:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4001 00000100:00080000:2.0:1767318776.004450:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318776.004456:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767318776.004489:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894281216/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767318776.004515:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318776.004518:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318776.004520:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318776.004524:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4025 00000100:00080000:2.0:1767318776.004527:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318776.004531:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318776.004539:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318776.004552:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894281344/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318776.004632:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318776.004645:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894281472:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318776.004985:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894281216:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767318776.005043:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894281344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318776.009652:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894281472:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318776.009776:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318776.009783:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318776.009788:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894281344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318776.836253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318776.900339:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318777.860291:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318777.929863:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318778.885289:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318778.949990:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318779.908222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318779.972352:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318780.932507:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318780.996475:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318781.127327:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318781.127339:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318781.127361:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318781.127365:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318781.127369:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318781.127381:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4027 00000100:00080000:0.0:1767318781.127403:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318781.127411:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318781.127422:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318781.127458:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fbb80 x1853163894281600/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318781.127902:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894281600:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318781.128103:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894281728:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318781.131489:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894281728:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767318781.131627:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318781.131634:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318781.131638:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894281600:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318781.957255:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318782.020382:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318782.980228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318783.044299:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318784.006629:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318784.068996:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318785.030100:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318785.101829:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318786.052284:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318786.117984:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318786.245409:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318786.245422:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318786.245425:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318786.245429:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318786.245434:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318786.245445:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4032 00000100:00080000:0.0:1767318786.245458:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318786.245465:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318786.245478:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318786.245522:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa680 x1853163894281856/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318786.245971:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894281984:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318786.246325:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894281856:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767318786.260544:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767318786.260572:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767318786.260579:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894281856:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318786.277887:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894281984:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318787.076253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318787.142413:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318788.101354:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318788.164243:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318789.124260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318789.188336:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318790.148461:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318790.212497:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318791.172208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318791.238138:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318791.364221:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318791.364242:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318791.364246:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318791.364250:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318791.364255:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318791.364267:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4037 00000100:00080000:0.0:1767318791.364278:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318791.364284:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318791.364296:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318791.364342:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8700 x1853163894282112/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318791.364555:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894282240:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318791.365864:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894282112:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318791.368728:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894282240:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318791.370925:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318791.370947:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318791.370954:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894282112:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318792.196180:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318792.260508:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318793.220263:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318793.287164:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318794.244267:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318794.312374:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318795.268202:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318795.333878:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318796.296355:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318796.357045:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318796.484412:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318796.484423:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318796.484426:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318796.484430:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318796.484434:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318796.484444:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4042 00000100:00080000:0.0:1767318796.484456:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318796.484481:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318796.484506:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318796.484539:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9c00 x1853163894282368/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318796.484723:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894282496:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318796.484845:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894282368:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767318796.487163:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318796.487179:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318796.487184:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894282368:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318796.487657:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894282496:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318797.316233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318797.381541:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318798.340275:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318798.404299:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318799.364372:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318799.428282:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318800.388224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318800.453175:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318801.412342:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318801.477517:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318801.604760:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318776/real 1767318776] req@ffff9cfe29109f80 x1853163894281216/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318801 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318801.604791:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29109f80 x1853163894281216/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318801 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318801.604810:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318801.604831:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767318801.604836:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894281216:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767318801.604852:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318801.604857:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767318801.604860:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318801.604865:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4027 00000100:00080000:2.0:1767318801.604874:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318801.604881:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767318801.604909:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894282624/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767318801.604938:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318801.604943:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318801.604945:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318801.604949:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4047 00000100:00080000:2.0:1767318801.604952:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318801.604956:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318801.604965:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318801.604977:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894282752/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318801.605069:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894282880:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318801.605239:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894282624:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767318801.605274:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894282752:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318801.624109:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318801.624126:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318801.624132:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894282752:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318801.628117:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894282880:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318802.436925:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318802.502378:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318803.460374:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318803.525847:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318804.486535:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318804.549262:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318805.508744:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318805.572775:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318806.535110:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318806.597390:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318806.724831:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318806.724845:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318806.724848:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318806.724853:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318806.724858:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318806.724868:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4052 00000100:00080000:3.0:1767318806.724878:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318806.724884:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318806.724895:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318806.724934:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894283008/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318806.725006:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894283008:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318806.725253:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894283136:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318806.729356:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894283136:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318806.729490:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318806.729509:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318806.729514:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894283008:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318807.556437:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318807.620401:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318808.580348:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318808.653738:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318809.604265:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318809.670486:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318810.629060:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318810.692381:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318811.652184:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318811.716459:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318811.845379:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318811.845390:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318811.845393:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318811.845397:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318811.845401:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318811.845411:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4058 00000100:00080000:0.0:1767318811.845431:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318811.845438:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318811.845449:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318811.845484:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894283264/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318811.845603:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894283392:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318811.845727:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894283264:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318811.850149:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894283392:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318811.850291:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318811.850327:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318811.850331:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894283264:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318812.676416:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318812.741630:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318813.700227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318813.767219:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318814.724998:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318814.788448:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318815.748450:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318815.817847:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318816.772240:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318816.836409:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318816.968742:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318816.968754:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318816.968757:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318816.968761:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318816.968766:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318816.968776:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4063 00000100:00080000:3.0:1767318816.968786:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318816.968793:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318816.968805:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318816.968858:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894283520/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318816.968915:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767318816.968931:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894283648:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318816.970642:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894283520:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318816.972887:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894283648:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318816.975886:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318816.975903:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318816.975909:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894283520:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318817.797012:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318817.862877:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318818.820454:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318818.884495:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318819.844219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318819.912158:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318820.868580:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318820.932408:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318821.892230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318821.959626:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318822.085273:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318822.085285:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318822.085288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318822.085293:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318822.085297:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318822.085308:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4068 00000100:00080000:1.0:1767318822.085490:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318822.085501:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318822.085514:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318822.085550:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1500 x1853163894283776/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318822.085619:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894283904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318822.086012:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894283776:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318822.090849:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318822.090869:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318822.090875:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894283776:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318822.090953:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894283904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318822.916224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318822.985412:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318823.943669:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318824.007263:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318824.964313:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318825.028364:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318825.988246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318826.052315:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318826.180315:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318801/real 1767318801] req@ffff9cfe29108e00 x1853163894282624/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318826 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318826.180353:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29108e00 x1853163894282624/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318826 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318826.180374:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318826.180384:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318826.180389:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894282624:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318826.180549:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318826.180555:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318826.180558:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318826.180563:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4052 00000100:00080000:1.0:1767318826.180572:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318826.180578:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318826.180610:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0380 x1853163894284032/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318826.180632:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318826.180636:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318826.180637:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318826.180641:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4073 00000100:00080000:1.0:1767318826.180644:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318826.180648:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318826.180658:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318826.180669:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2680 x1853163894284160/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318826.180731:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894284288:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318826.184856:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894284032:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767318826.184974:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894284160:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318826.191046:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318826.191061:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318826.191066:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894284160:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318826.198485:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894284288:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318827.014749:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318827.081065:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318828.036753:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318828.105517:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318829.061003:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318829.128346:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318830.084322:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318830.148393:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318831.108221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318831.173068:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318831.301216:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318831.301229:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318831.301232:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318831.301237:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318831.301242:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318831.301253:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4077 00000100:00080000:0.0:1767318831.301264:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318831.301271:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318831.301284:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318831.301326:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894284416/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318831.301401:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894284544:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318831.302184:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894284416:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318831.304293:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894284544:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318831.308132:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318831.308153:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318831.308158:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894284416:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318832.134526:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318832.196948:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318833.156245:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318833.221851:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318834.180647:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318834.245753:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318835.204906:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318835.268383:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318836.230054:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318836.293142:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318836.420661:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318836.420690:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318836.420693:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318836.420697:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318836.420701:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318836.420711:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4082 00000100:00080000:0.0:1767318836.420722:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318836.420730:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318836.420741:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318836.420774:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9f80 x1853163894284672/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318836.420833:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894284800:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318836.421385:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894284672:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318836.425889:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894284800:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318836.426134:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318836.426143:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318836.426147:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894284672:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318837.252244:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318837.316472:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318838.276522:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318838.343962:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318839.300239:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318839.364291:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318840.324228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318840.388633:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318841.348182:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318841.412391:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318841.540214:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318841.540226:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318841.540229:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318841.540233:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318841.540237:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318841.540247:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4087 00000100:00080000:1.0:1767318841.540258:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318841.540264:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318841.540286:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318841.540324:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2d80 x1853163894284928/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318841.540417:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894284928:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318841.540524:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894285056:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318841.545719:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318841.545733:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318841.545739:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894284928:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318841.547580:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894285056:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318842.372228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318842.442553:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318843.396308:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318843.460494:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318844.420226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318844.487442:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318845.444220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318845.508316:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318846.469160:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318846.534608:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318846.660464:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318846.660475:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318846.660477:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318846.660481:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318846.660485:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318846.660495:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4092 00000100:00080000:1.0:1767318846.660504:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318846.660511:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318846.660522:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318846.660556:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3100 x1853163894285184/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318846.660662:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894285184:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318846.660777:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894285312:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318846.663438:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894285312:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318846.668466:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318846.668482:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318846.668488:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894285184:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318847.492380:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318847.556274:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318848.516737:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318848.580335:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318849.540197:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318849.605111:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318850.564168:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318850.628474:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318851.588262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318851.652323:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318851.781435:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318851.781444:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318851.781448:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318851.781452:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318851.781457:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318851.781467:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4098 00000100:00080000:0.0:1767318851.781479:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318851.781487:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318851.781498:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318851.781547:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8a80 x1853163894285440/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318851.781641:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318826/real 1767318826] req@ffff9cfe0f3d0380 x1853163894284032/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318851 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318851.781668:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0380 x1853163894284032/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318851 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318851.781688:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894285440:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318851.782813:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318851.782872:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767318851.782877:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894284032:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767318851.782993:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894285568:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318851.784348:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318851.784356:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318851.784359:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318851.784366:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4077 00000100:00080000:0.0:1767318851.784374:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318851.784381:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767318851.784412:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8000 x1853163894285696/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318851.784458:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894285696:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767318851.788333:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318851.788352:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318851.788358:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894285440:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318851.788534:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894285568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318852.612219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318852.676449:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318853.636231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318853.713646:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318854.663451:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318854.726267:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318855.686299:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318855.748544:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318856.708242:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318856.772468:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318856.900403:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318856.900415:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318856.900418:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318856.900423:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318856.900427:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318856.900438:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4103 00000100:00080000:2.0:1767318856.900450:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318856.900458:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318856.900470:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318856.900505:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894285824/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318856.900572:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318856.900584:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894285952:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318856.900626:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894285824:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318856.911311:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894285952:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318856.915133:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318856.915157:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318856.915163:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894285824:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318857.732175:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318857.796433:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318858.756224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318858.820547:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318859.780194:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318859.844562:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318860.804232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318860.868773:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318861.828231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318861.892635:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318862.020652:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318862.020661:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318862.020664:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318862.020688:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318862.020692:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318862.020701:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4108 00000100:00080000:0.0:1767318862.020711:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318862.020718:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318862.020728:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318862.020759:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8a80 x1853163894286080/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318862.020866:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894286208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318862.020995:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894286080:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318862.023336:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318862.023347:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318862.023351:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894286080:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318862.025066:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894286208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318862.852346:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318862.916467:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318863.876259:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318863.940575:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318864.903527:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318864.964465:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318865.924200:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318865.988307:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318866.948274:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318867.016596:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318867.140535:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318867.140545:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318867.140548:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318867.140553:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318867.140557:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318867.140567:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4113 00000100:00080000:2.0:1767318867.140577:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318867.140585:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318867.140598:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318867.140633:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894286336/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318867.140701:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318867.140714:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894286464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318867.140846:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894286336:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318867.152161:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1767318867.152171:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894286464:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318867.152177:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318867.152184:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894286336:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318867.972146:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318868.037955:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318868.996420:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318869.060453:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318870.020324:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318870.089380:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318871.044273:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318871.108333:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318872.075384:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318872.132557:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318872.260282:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318872.260294:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318872.260297:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318872.260302:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318872.260306:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318872.260317:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4118 00000100:00080000:0.0:1767318872.260329:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318872.260336:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318872.260365:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318872.260395:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb480 x1853163894286592/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318872.260589:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894286592:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318872.260895:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894286720:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318872.269172:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318872.269187:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318872.269192:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894286592:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318872.270271:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894286720:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318873.095269:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318873.156878:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318874.116260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318874.180316:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318875.142946:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318875.204387:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318876.164706:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318876.229722:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318876.356255:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318851/real 1767318851] req@ffff9cfe089f8000 x1853163894285696/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318876 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767318876.356293:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089f8000 x1853163894285696/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318876 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767318876.356331:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318876.356356:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767318876.356361:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894285696:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318876.356439:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318876.356444:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318876.356452:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318876.356469:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4103 00000100:00080000:1.0:1767318876.356479:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318876.356485:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318876.356514:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0380 x1853163894286848/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767318876.356542:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318876.356546:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318876.356548:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318876.356552:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4123 00000100:00080000:1.0:1767318876.356556:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318876.356559:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318876.356567:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318876.356578:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1180 x1853163894286976/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318876.356702:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894286848:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767318876.356796:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894286976:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318876.356880:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894287104:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318876.369151:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318876.369167:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318876.369172:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894286976:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318876.372077:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894287104:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318877.188396:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318877.252868:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318878.214227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318878.276409:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318879.236229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318879.302430:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318880.260329:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318880.325515:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318881.284271:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318881.354632:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318881.477876:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318881.477889:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318881.477892:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318881.477897:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318881.477902:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318881.477926:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4127 00000100:00080000:2.0:1767318881.477938:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318881.477946:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318881.477958:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318881.477999:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894287232/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318881.478163:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318881.478182:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894287360:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318881.478696:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894287232:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318881.481577:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894287360:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318881.487337:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318881.487354:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318881.487360:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894287232:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318882.308971:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318882.372287:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318883.333716:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318883.396306:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318884.356474:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318884.420902:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318885.380208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318885.445623:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318886.404414:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318886.469559:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318886.598048:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318886.598059:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318886.598062:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318886.598066:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318886.598071:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318886.598098:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4132 00000100:00080000:0.0:1767318886.598107:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318886.598134:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318886.598185:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318886.598231:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9880 x1853163894287488/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318886.598313:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318886.598327:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894287616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318886.599694:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894287488:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318886.606553:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318886.606634:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318886.606640:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894287488:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318886.607358:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894287616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318887.428214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318887.492505:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318888.452252:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318888.516450:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318889.476214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318889.541011:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318890.500217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318890.564536:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318891.524264:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318891.588372:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318891.716866:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318891.716879:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318891.716882:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318891.716887:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318891.716892:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318891.716915:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4137 00000100:00080000:0.0:1767318891.716924:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318891.716955:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318891.716968:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318891.717004:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8e00 x1853163894287744/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318891.717074:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894287872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318891.719457:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894287744:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767318891.723182:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318891.723213:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318891.723218:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894287744:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318891.723636:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894287872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318892.548593:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318892.627321:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318893.572236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318893.638638:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318894.596312:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318894.660605:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318895.620218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318895.684362:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318896.644228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318896.708260:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318896.839517:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318896.839526:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318896.839529:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318896.839533:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318896.839537:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318896.839546:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4143 00000100:00080000:0.0:1767318896.839556:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318896.839564:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318896.839575:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318896.839611:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9500 x1853163894288000/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318896.839687:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894288128:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318896.839870:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894288000:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318896.851376:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318896.851392:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318896.851398:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894288000:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318896.852919:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894288128:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318897.668203:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318897.732238:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318898.693682:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318898.756823:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318899.716248:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318899.783717:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318900.740203:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318900.804722:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318901.765152:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318901.828451:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318901.956244:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318876/real 1767318876] req@ffff9cfe0f3d0380 x1853163894286848/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318901 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318901.956277:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0380 x1853163894286848/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318901 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318901.956298:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318901.956320:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767318901.956324:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894286848:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767318901.956778:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318901.956830:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767318901.956833:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318901.956839:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4127 00000100:00080000:3.0:1767318901.956848:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318901.956855:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767318901.956885:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894288256/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767318901.956903:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318901.956906:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318901.956908:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318901.956912:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4148 00000100:00080000:3.0:1767318901.956915:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318901.956919:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318901.956927:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318901.956937:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7100 x1853163894288384/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318901.957234:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894288256:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767318901.957319:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894288384:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318901.957591:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318901.957603:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894288512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318901.959611:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894288512:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318901.960040:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318901.960047:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318901.960051:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894288384:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318902.788756:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318902.852483:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318903.813123:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318903.877099:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318904.836209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318904.901284:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318905.861323:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318905.924371:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318906.884356:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318906.952429:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318907.076189:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318907.076200:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318907.076203:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318907.076207:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318907.076211:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318907.076238:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4153 00000100:00080000:3.0:1767318907.076261:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318907.076275:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318907.076294:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318907.076325:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894288640/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318907.076395:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894288768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318907.076424:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894288640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318907.096366:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894288768:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318907.112631:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318907.112649:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318907.112654:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894288640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318907.909447:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318907.973058:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318908.932268:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318909.001639:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318909.956211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318910.021343:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318910.980147:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318911.044305:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318912.004798:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318912.068357:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318912.199884:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318912.199897:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318912.199900:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318912.199904:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318912.199910:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318912.199923:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4158 00000100:00080000:2.0:1767318912.199936:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318912.199944:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318912.199959:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318912.199992:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894288896/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318912.200154:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894289024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318912.200751:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894288896:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318912.214480:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894289024:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318912.214550:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318912.214557:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318912.214560:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894288896:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318913.028234:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318913.093769:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318914.052302:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318914.117484:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318915.076220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318915.141549:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318916.100261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318916.164339:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318917.124481:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318917.188264:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318917.317210:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318917.317221:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318917.317224:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318917.317228:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318917.317233:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318917.317243:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4163 00000100:00080000:0.0:1767318917.317252:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318917.317259:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318917.317270:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318917.317306:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb100 x1853163894289152/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318917.317383:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318917.317396:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894289280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318917.317632:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894289152:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318917.324388:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318917.324406:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318917.324412:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894289152:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318917.324843:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894289280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318918.148798:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318918.212402:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318919.172213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318919.236307:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318920.196217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318920.260537:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318921.220281:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318921.285293:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318922.246883:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318922.308486:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318922.436780:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318922.436805:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318922.436808:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318922.436812:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318922.436816:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318922.436825:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4168 00000100:00080000:0.0:1767318922.436834:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318922.436840:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318922.436850:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318922.436883:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9500 x1853163894289408/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318922.436941:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318922.436954:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894289536:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318922.437031:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894289408:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318922.450166:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894289536:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318922.461733:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318922.461752:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318922.461758:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894289408:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318923.268226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318923.332309:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318924.295447:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318924.356572:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318925.317877:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318925.380550:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318926.341782:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318926.404313:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767318926.532226:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318901/real 1767318901] req@ffff9cfe18fd5880 x1853163894288256/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318926 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767318926.532259:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd5880 x1853163894288256/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318926 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767318926.532278:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318926.532322:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767318926.532327:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894288256:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767318926.532425:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318926.532430:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318926.532433:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318926.532438:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4153 00000100:00080000:0.0:1767318926.532447:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318926.532454:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767318926.532485:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb800 x1853163894289664/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767318926.532530:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318926.532533:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318926.532535:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318926.532539:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4173 00000100:00080000:0.0:1767318926.532543:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318926.532547:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318926.532556:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318926.532568:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8e00 x1853163894289792/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318926.532611:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318926.532623:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894289920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318926.533561:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894289664:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767318926.533621:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894289792:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318926.552043:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318926.552060:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318926.552065:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894289792:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318926.552490:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894289920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318927.365526:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318927.429734:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318928.388372:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318928.455047:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318929.412249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318929.476648:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318930.438207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318930.500387:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318931.460221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318931.524940:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318931.652170:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318931.652182:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318931.652185:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318931.652188:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318931.652192:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318931.652203:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4177 00000100:00080000:0.0:1767318931.652213:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318931.652238:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318931.652250:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318931.652280:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9880 x1853163894290048/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318931.652351:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894290176:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318931.654153:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894290048:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318931.666556:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894290176:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767318931.667758:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318931.667769:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318931.667775:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894290048:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318932.484236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318932.549112:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318933.508221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318933.577446:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318934.532217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318934.596743:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318935.556209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318935.622643:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318936.581274:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318936.644703:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318936.772852:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318936.772865:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318936.772868:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318936.772872:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318936.773171:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318936.773185:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4183 00000100:00080000:0.0:1767318936.773199:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318936.773207:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318936.773220:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318936.773533:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8000 x1853163894290304/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318936.773656:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894290304:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318936.773828:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767318936.773839:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894290432:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318936.776424:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894290432:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318936.776573:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318936.776579:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318936.776583:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894290304:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318937.604290:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318937.668518:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318938.628275:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318938.696797:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318939.652256:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318939.718266:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318940.676314:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318940.744744:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318941.700259:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318941.765672:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318941.892201:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318941.892212:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318941.892216:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318941.892219:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318941.892223:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318941.892234:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4188 00000100:00080000:0.0:1767318941.892245:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318941.892253:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318941.892273:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318941.892326:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb480 x1853163894290560/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318941.892533:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894290560:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318941.892832:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894290688:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318941.907332:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318941.907347:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318941.907352:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894290560:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318941.910907:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894290688:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318942.724212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318942.789475:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318943.748227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318943.812334:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318944.772484:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318944.836742:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318945.796283:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318945.860578:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318946.821374:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318946.884447:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318947.013780:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318947.013792:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318947.013795:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318947.013798:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318947.013803:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318947.013814:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4193 00000100:00080000:1.0:1767318947.013825:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318947.013850:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318947.013861:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318947.013893:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0380 x1853163894290816/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318947.013972:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894290944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318947.014766:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894290816:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318947.020993:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318947.021012:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318947.021019:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894290816:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318947.022062:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894290944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318947.844216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318947.910372:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318948.868218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318948.932378:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318949.892923:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318949.956323:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318950.917873:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318950.980754:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767318951.108727:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318926/real 1767318926] req@ffff9cfe089fb800 x1853163894289664/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318951 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767318951.108765:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fb800 x1853163894289664/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318951 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767318951.108784:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318951.108806:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767318951.108811:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894289664:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318951.109489:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318951.109495:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767318951.109498:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318951.109504:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4177 00000100:00080000:1.0:1767318951.109513:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318951.109519:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767318951.109553:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1180 x1853163894291072/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318951.109613:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894291072:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767318951.109726:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318951.109730:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318951.109732:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318951.109736:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4198 00000100:00080000:1.0:1767318951.109741:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318951.109745:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318951.109754:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318951.109767:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3800 x1853163894291200/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318951.117232:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894291200:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318951.118043:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894291328:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318951.120610:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894291328:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318951.122128:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318951.122140:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318951.122145:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894291200:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318951.940262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318952.004278:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318952.964470:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318953.028478:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318953.993353:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318954.053308:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318955.012350:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318955.076286:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318956.036230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318956.101852:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318956.228441:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318956.228452:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318956.228466:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318956.228471:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318956.228475:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318956.228503:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4202 00000100:00080000:0.0:1767318956.228513:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318956.228520:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318956.228531:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318956.228578:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb800 x1853163894291456/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318956.228650:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894291584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318956.229048:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894291456:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318956.234682:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318956.234700:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318956.234705:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894291456:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767318956.234808:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894291584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318957.060244:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318957.124271:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318958.084349:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318958.149274:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318959.108341:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318959.172667:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318960.132212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318960.198463:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318961.156648:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318961.220426:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767318961.348369:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318961.348380:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767318961.348383:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767318961.348387:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767318961.348391:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767318961.348403:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4207 00000100:00080000:1.0:1767318961.348412:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767318961.348420:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767318961.348440:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767318961.348477:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2300 x1853163894291712/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767318961.348557:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894291840:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318961.348734:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894291712:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767318961.356708:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318961.356724:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318961.356729:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894291712:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318961.356907:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894291840:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318962.183721:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318962.244629:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318963.207587:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318963.268857:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318964.228331:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767318964.296628:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318965.252576:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318965.318442:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318966.276243:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318966.340333:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318966.468328:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318966.468336:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318966.468351:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318966.468354:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318966.468358:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318966.468368:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4212 00000100:00080000:2.0:1767318966.468377:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318966.468384:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318966.468396:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318966.468427:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894291968/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318966.468489:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894292096:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318966.468772:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894291968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318966.482019:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894292096:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318966.484033:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318966.484046:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318966.484051:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894291968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318967.300246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318967.364358:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318968.325076:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318968.388641:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318969.348338:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318969.412400:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318970.372253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318970.436705:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318971.396284:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318971.460679:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767318971.588393:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318971.588403:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767318971.588406:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318971.588410:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318971.588415:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318971.588425:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4217 00000100:00080000:0.0:1767318971.588434:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318971.588441:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318971.588453:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767318971.588489:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9180 x1853163894292224/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318971.588551:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894292224:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318971.589387:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894292352:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318971.600687:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318971.600702:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318971.600708:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894292224:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767318971.602214:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894292352:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318972.420247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318972.484342:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318973.444373:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318973.509058:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318974.469423:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318974.533197:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318975.492223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318975.556414:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318976.516277:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318976.580995:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767318976.708233:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318951/real 1767318951] req@ffff9cfe0f3d1180 x1853163894291072/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318976 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767318976.708266:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d1180 x1853163894291072/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767318976 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767318976.708284:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767318976.708321:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767318976.708325:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894291072:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767318976.708394:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318976.708400:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767318976.708403:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318976.708408:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4202 00000100:00080000:0.0:1767318976.708416:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318976.708422:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767318976.708454:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894292480/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767318976.708486:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767318976.708490:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767318976.708492:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767318976.708496:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4222 00000100:00080000:0.0:1767318976.708500:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767318976.708504:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767318976.708514:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318976.708516:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894292480:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767318976.708526:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089faa00 x1853163894292608/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767318976.708589:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767318976.708600:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894292736:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767318976.708619:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894292608:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767318976.711020:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1767318976.711027:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894292736:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767318976.711029:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767318976.711033:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894292608:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318977.540219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318977.610555:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318978.564511:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318978.628698:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318979.590743:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318979.652357:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318980.612259:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318980.677555:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318981.636258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318981.703850:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318981.833390:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318981.833399:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318981.833402:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318981.833405:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318981.833410:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318981.833420:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4228 00000100:00080000:2.0:1767318981.833432:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318981.833439:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318981.833450:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318981.833481:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894292864/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318981.833778:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767318981.833793:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894292992:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318981.838127:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894292864:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318981.846243:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894292992:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318981.853827:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318981.853843:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318981.853849:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894292864:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318982.660225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318982.724369:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318983.684223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318983.748497:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318984.708291:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318984.772307:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318985.732900:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318985.797168:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318986.756264:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318986.820523:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318986.948236:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318986.948248:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318986.948251:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318986.948255:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318986.948260:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318986.948270:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4233 00000100:00080000:2.0:1767318986.948282:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318986.948289:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318986.948301:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318986.948334:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894293120/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767318986.948403:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767318986.948420:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894293248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318986.950374:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894293120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318986.958622:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894293248:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318986.964904:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318986.964922:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318986.964928:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894293120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318987.780234:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318987.847375:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318988.806035:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318988.870142:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318989.828335:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318989.893320:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318990.852273:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318990.916311:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318991.876793:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318991.941773:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767318992.068222:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318992.068234:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767318992.068237:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767318992.068242:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767318992.068247:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767318992.068258:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4238 00000100:00080000:2.0:1767318992.068270:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767318992.068278:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767318992.068318:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767318992.068354:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894293376/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318992.068595:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894293504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767318992.070883:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894293504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767318992.071918:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894293376:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767318992.074881:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767318992.074899:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767318992.074917:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894293376:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318992.901450:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318992.964393:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318993.924255:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318993.997515:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318994.949119:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318995.015424:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318995.972246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767318996.036313:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318996.996211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318997.060839:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767318997.189143:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318997.189154:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767318997.189156:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767318997.189160:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767318997.189164:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767318997.189173:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4243 00000100:00080000:3.0:1767318997.189183:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767318997.189189:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767318997.189200:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767318997.189233:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894293632/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767318997.189313:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767318997.189328:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894293760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767318997.189667:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894293632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767318997.192707:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894293760:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767318997.197686:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767318997.197704:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767318997.197709:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894293632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767318998.020216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318998.084781:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767318999.044200:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767318999.108611:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319000.068231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319000.132449:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319001.092195:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319001.156442:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319001.284253:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318976/real 1767318976] req@ffff9cfe089fad80 x1853163894292480/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319001 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319001.284293:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fad80 x1853163894292480/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319001 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319001.284320:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319001.284382:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767319001.284388:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894292480:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767319001.284601:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319001.284607:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767319001.284611:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319001.284617:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4228 00000100:00080000:2.0:1767319001.284627:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319001.284634:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767319001.284665:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910a680 x1853163894293888/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767319001.284690:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319001.284695:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319001.284696:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319001.284701:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4248 00000100:00080000:2.0:1767319001.284704:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319001.284708:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319001.284718:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319001.284732:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894294016/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319001.284792:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894294144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319001.285643:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894293888:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767319001.285710:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894294016:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319001.293109:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319001.293123:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319001.293127:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894294016:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319001.293268:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894294144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319002.118575:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319002.180398:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319003.140235:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319003.206236:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319004.164530:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319004.228720:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319005.188291:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319005.252663:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319006.212197:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319006.277329:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319006.404202:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319006.404214:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319006.404217:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319006.404221:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319006.404226:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319006.404536:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4252 00000100:00080000:2.0:1767319006.404546:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319006.404553:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319006.404564:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319006.404604:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894294272/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319006.404709:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894294400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319006.404856:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894294272:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319006.415110:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319006.415125:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319006.415130:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894294272:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319006.415414:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894294400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319007.237135:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319007.301840:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319008.260164:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319008.325009:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319009.284233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319009.350347:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319010.308306:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319010.375193:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319011.332274:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319011.396426:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319011.524600:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319011.524610:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319011.524774:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319011.524779:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319011.524784:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319011.524795:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4257 00000100:00080000:1.0:1767319011.524807:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319011.524814:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319011.524828:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319011.524868:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2a00 x1853163894294528/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319011.524937:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894294528:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319011.525320:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319011.525331:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894294656:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319011.535388:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319011.535402:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319011.535407:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894294528:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319011.535912:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894294656:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319012.356295:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319012.420472:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319013.382865:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319013.444217:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319014.410998:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319014.472041:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319015.428184:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319015.492920:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319016.452241:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319016.516370:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319016.649172:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319016.649183:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319016.649186:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319016.649191:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319016.649196:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319016.649206:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4262 00000100:00080000:1.0:1767319016.649219:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319016.649228:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319016.649240:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319016.649278:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3b80 x1853163894294784/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319016.649354:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894294784:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319016.652042:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767319016.652073:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894294912:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319016.656833:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319016.656850:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319016.656856:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894294784:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319016.657044:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894294912:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319017.476224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319017.540273:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319018.504635:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319018.564588:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319019.524444:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319019.588940:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319020.548300:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319020.613043:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319021.572166:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319021.636329:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319021.764253:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319021.764265:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319021.764268:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319021.764271:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319021.764276:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319021.764286:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4268 00000100:00080000:1.0:1767319021.764297:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319021.764306:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319021.764338:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319021.764377:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2a00 x1853163894295040/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319021.764472:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894295168:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319021.765068:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894295040:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319021.774172:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319021.774194:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319021.774201:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894295040:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319021.776766:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894295168:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319022.596208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319022.661759:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319023.621335:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319023.685226:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319024.647008:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319024.710061:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319025.668315:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319025.732815:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319026.692585:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319026.756391:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319026.884217:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319026.884227:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319026.884230:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319026.884234:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319026.884238:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319026.884248:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4273 00000100:00080000:1.0:1767319026.884259:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319026.884267:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319026.884279:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319026.884312:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2300 x1853163894295296/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319026.884398:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894295424:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319026.884916:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319001/real 1767319001] req@ffff9cfe2910a680 x1853163894293888/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319026 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319026.884946:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe2910a680 x1853163894293888/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319026 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319026.884960:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894295296:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319026.885011:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319026.885019:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767319026.885024:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894293888:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767319026.885193:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319026.885198:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319026.885200:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319026.885204:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4252 00000100:00080000:1.0:1767319026.885208:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319026.885213:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767319026.885235:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0380 x1853163894295552/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319026.885348:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894295552:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767319026.887851:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319026.887865:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319026.887870:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894295296:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319026.891152:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894295424:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319027.716559:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319027.781896:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319028.742228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319028.805301:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319029.764221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319029.828481:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319030.788325:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319030.852391:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319031.813060:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319031.876590:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319032.005425:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319032.005437:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319032.005440:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319032.005444:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319032.005450:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319032.005462:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4278 00000100:00080000:1.0:1767319032.005473:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319032.005480:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319032.005492:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319032.005531:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3800 x1853163894295680/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319032.005631:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319032.005647:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894295808:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319032.005757:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894295680:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319032.011609:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1767319032.011616:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894295808:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319032.011618:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319032.011633:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894295680:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319032.836222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319032.900317:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319033.860224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319033.924517:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319034.886784:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319034.948729:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319035.908257:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319035.972381:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319036.934129:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319036.997700:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319037.128852:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319037.128864:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319037.128866:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319037.128870:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319037.128874:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319037.128887:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4283 00000100:00080000:3.0:1767319037.128898:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319037.128905:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319037.128916:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319037.128950:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894295936/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319037.129039:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894296064:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319037.129608:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894295936:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319037.133186:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894296064:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319037.140942:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319037.140957:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319037.140963:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894295936:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319037.956258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319038.020915:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319038.980243:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319039.047844:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319040.004222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319040.068502:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319041.029387:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319041.095767:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319042.052206:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319042.116330:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319042.244563:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319042.244575:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319042.244578:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319042.244582:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319042.244587:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319042.244600:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4288 00000100:00080000:3.0:1767319042.244614:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319042.244621:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319042.244634:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319042.244674:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894296192/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319042.244754:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894296320:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319042.245492:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894296192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319042.247747:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894296320:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319042.248049:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319042.248057:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319042.248061:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894296192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319043.076245:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319043.142061:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319044.100291:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319044.164597:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319045.124893:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319045.188395:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319046.148279:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319046.212678:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319047.172214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319047.240673:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319047.364237:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319047.364252:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319047.364282:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319047.364287:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319047.364293:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319047.364306:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4293 00000100:00080000:3.0:1767319047.364318:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319047.364326:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319047.364339:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319047.364388:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6680 x1853163894296448/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319047.364523:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894296448:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319047.364633:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319047.364644:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894296576:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319047.369078:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319047.369131:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319047.369136:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894296448:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319047.372852:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894296576:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319048.198642:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319048.260350:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319049.220539:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319049.284322:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319050.246002:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319050.308342:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319051.268654:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319051.332422:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319051.460226:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319026/real 1767319026] req@ffff9cfe0f3d0380 x1853163894295552/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319051 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319051.460269:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0380 x1853163894295552/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319051 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319051.460291:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319051.460316:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767319051.460320:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894295552:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767319051.460579:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319051.460615:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767319051.460619:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319051.460624:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4278 00000100:00080000:2.0:1767319051.460632:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319051.460640:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767319051.460672:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894296704/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767319051.460698:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319051.460702:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319051.460704:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319051.460708:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4298 00000100:00080000:2.0:1767319051.460712:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319051.460715:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319051.460725:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319051.460736:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894296832/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319051.460833:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894296704:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767319051.460931:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894296832:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319051.461020:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894296960:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319051.466144:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894296960:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319051.466271:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319051.466278:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319051.466282:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894296832:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319052.293054:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319052.356529:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319053.316472:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319053.380417:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319054.340261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319054.406068:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319055.364222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319055.428811:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319056.388552:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319056.452558:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319056.580930:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319056.580942:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319056.580945:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319056.580949:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319056.580977:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319056.580988:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4302 00000100:00080000:3.0:1767319056.580999:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319056.581008:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319056.581022:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319056.581076:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894297088/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319056.581196:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894297216:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319056.584736:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894297088:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319056.596601:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894297216:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319056.597425:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319056.597434:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319056.597438:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894297088:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319057.412253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319057.478943:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319058.439520:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319058.501430:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319059.460527:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319059.529058:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319060.484525:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319060.554023:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319061.510477:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319061.572443:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319061.700296:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319061.700308:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319061.700311:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319061.700315:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319061.700319:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319061.700330:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4307 00000100:00080000:3.0:1767319061.700341:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319061.700348:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319061.700361:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319061.700411:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894297344/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319061.700483:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319061.700501:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894297472:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319061.700909:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894297344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319061.703621:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894297472:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319061.714511:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319061.714528:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319061.714534:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894297344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319062.532291:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319062.597267:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319063.556840:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319063.625539:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319064.580303:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319064.649415:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319065.604379:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319065.668408:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319066.628220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319066.692351:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319066.820805:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319066.820812:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319066.820815:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319066.820819:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319066.820823:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319066.820833:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4313 00000100:00080000:3.0:1767319066.820842:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319066.820848:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319066.820857:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319066.820884:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894297600/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319066.821006:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894297600:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319066.821112:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319066.821121:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894297728:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319066.824528:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319066.824543:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319066.824543:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894297728:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319066.824551:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894297600:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319067.652229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319067.716911:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319068.676232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319068.742986:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319069.701939:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319069.764834:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319070.724221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319070.788362:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319071.749496:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319071.814693:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319071.940212:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319071.940224:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319071.940227:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319071.940232:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319071.940237:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319071.940250:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4318 00000100:00080000:3.0:1767319071.940260:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319071.940268:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319071.940280:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319071.940322:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894297856/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319071.940390:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894297856:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319071.940406:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319071.940420:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894297984:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319071.950369:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894297984:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319071.953872:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319071.953900:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319071.953906:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894297856:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319072.773118:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319072.836928:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319073.798470:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319073.863374:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319074.820225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319074.884588:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319075.844246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319075.911286:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319076.036306:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319051/real 1767319051] req@ffff9cfe29109c00 x1853163894296704/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319076 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319076.036342:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29109c00 x1853163894296704/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319076 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319076.036362:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319076.036392:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767319076.036397:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894296704:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767319076.036865:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319076.036882:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767319076.036885:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319076.036892:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4302 00000100:00080000:2.0:1767319076.036917:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319076.036924:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767319076.036957:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894298112/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767319076.036984:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319076.036988:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319076.036990:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319076.036994:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4323 00000100:00080000:2.0:1767319076.036998:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319076.037001:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319076.037010:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319076.037022:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894298240/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319076.037075:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319076.037120:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894298368:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319076.038041:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894298112:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767319076.038161:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894298240:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319076.043760:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894298368:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319076.043983:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319076.043990:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319076.043994:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894298240:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319076.868551:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319076.932323:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319077.892443:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319077.956896:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319078.917147:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319078.982805:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319079.940225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319080.007061:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319080.964210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319081.030146:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319081.158217:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319081.158223:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319081.158226:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319081.158229:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319081.158232:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319081.158240:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4327 00000100:00080000:3.0:1767319081.158247:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319081.158253:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319081.158261:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319081.158288:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4380 x1853163894298496/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319081.158625:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319081.158647:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894298624:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319081.159237:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894298496:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319081.168358:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894298624:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319081.170485:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319081.170510:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319081.170516:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894298496:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319081.988351:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319082.054663:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319083.012239:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319083.076395:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319084.036363:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319084.100410:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319085.060553:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319085.126398:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319086.084250:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319086.150884:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319086.277140:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319086.277152:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319086.277155:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319086.277159:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319086.277164:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319086.277173:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4332 00000100:00080000:1.0:1767319086.277184:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319086.277192:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319086.277203:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319086.277241:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0380 x1853163894298752/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319086.277320:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894298752:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319086.279648:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894298880:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319086.285498:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894298880:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319086.287170:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319086.287185:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319086.287191:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894298752:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319087.108252:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319087.174964:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319088.132238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319088.196227:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319089.156271:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319089.220352:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319090.180302:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319090.244827:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319091.204164:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319091.269871:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319091.396298:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319091.396310:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319091.396312:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319091.396316:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319091.396321:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319091.396364:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4337 00000100:00080000:2.0:1767319091.396375:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319091.396382:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319091.396394:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319091.396430:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894299008/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319091.396504:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894299136:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319091.396952:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894299008:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319091.406451:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1767319091.406460:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894299136:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319091.406466:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319091.406472:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894299008:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319092.228231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319092.294199:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319093.252236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319093.318527:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319094.276216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319094.341554:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319095.300208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319095.368608:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319096.324463:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319096.388256:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319096.517971:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319096.517981:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319096.517984:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319096.517988:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319096.517992:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319096.518003:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4342 00000100:00080000:3.0:1767319096.518013:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319096.518020:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319096.518032:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319096.518132:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894299264/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319096.518220:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894299264:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319096.518389:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894299392:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319096.521680:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319096.521696:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319096.521717:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894299264:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319096.521722:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894299392:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319097.348215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319097.412321:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319098.377122:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319098.436897:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319099.396572:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319099.460334:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319100.422170:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319100.484290:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319101.445192:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319101.510980:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319101.636584:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319101.636594:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319101.636597:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319101.636601:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1767319101.636602:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319076/real 1767319076] req@ffff9cfe2910bb80 x1853163894298112/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319101 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767319101.636605:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319101.636611:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4347 00000100:00080000:3.0:1767319101.636620:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319101.636627:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767319101.636629:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe2910bb80 x1853163894298112/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319101 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:3.0:1767319101.636637:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00080000:1.0:1767319101.636646:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319101.636662:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767319101.636664:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894299520/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319101.636666:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894298112:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767319101.636689:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894299520:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319101.636817:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894299648:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319101.637585:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319101.637590:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319101.637592:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319101.637597:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4327 00000100:00080000:3.0:1767319101.637601:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319101.637606:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767319101.637625:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6680 x1853163894299776/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319101.639308:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894299776:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767319101.647608:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894299648:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319101.647845:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319101.647851:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319101.647855:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894299520:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319102.468210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319102.532391:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319103.492596:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319103.556331:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319104.516816:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319104.580270:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319105.542282:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319105.604255:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319106.564249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319106.628261:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319106.756245:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319106.756256:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319106.756259:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319106.756263:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319106.756268:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319106.756278:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4352 00000100:00080000:3.0:1767319106.756288:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319106.756295:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319106.756305:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319106.756362:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894299904/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319106.756636:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894299904:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319106.756825:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894300032:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319106.762736:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319106.762752:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319106.762757:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894299904:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319106.768347:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894300032:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319107.588254:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319107.653719:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319108.612264:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319108.676347:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319109.636252:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319109.700327:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319110.661181:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319110.724908:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319111.684445:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319111.749900:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319111.877140:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319111.877153:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319111.877156:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319111.877180:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319111.877184:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319111.877195:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4358 00000100:00080000:1.0:1767319111.877205:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319111.877212:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319111.877223:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319111.877254:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0a80 x1853163894300160/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319111.877332:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894300160:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319111.877516:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319111.877535:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894300288:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319111.882657:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319111.882672:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319111.882678:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894300160:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319111.882776:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894300288:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319112.708225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319112.772408:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319113.732547:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319113.801132:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319114.756189:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319114.823189:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319115.783520:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319115.844575:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319116.804212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319116.870695:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319116.997318:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319116.997339:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319116.997342:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319116.997346:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319116.997350:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319116.997360:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4363 00000100:00080000:2.0:1767319116.997369:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319116.997377:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319116.997387:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319116.997414:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894300416/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319116.997518:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894300544:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319116.997703:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894300416:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319117.014364:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894300544:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319117.014403:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319117.014411:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319117.014416:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894300416:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319117.829715:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319117.893014:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319118.852217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319118.916316:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319119.876874:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319119.940725:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319120.900857:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319120.964550:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319121.924213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319121.989905:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319122.116202:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319122.116213:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319122.116216:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319122.116219:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319122.116224:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319122.116234:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4368 00000100:00080000:1.0:1767319122.116245:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319122.116253:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319122.116265:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319122.116300:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3100 x1853163894300672/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319122.116407:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894300800:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319122.116792:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894300672:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319122.129217:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894300800:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319122.131958:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319122.131977:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319122.131983:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894300672:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319122.948256:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319123.014331:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319123.972184:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319124.036953:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319124.996208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319125.060341:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319126.020217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319126.085465:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319126.212189:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319101/real 1767319101] req@ffff9cfe18fd6680 x1853163894299776/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319126 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319126.212239:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd6680 x1853163894299776/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319126 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319126.212260:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319126.212275:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767319126.212279:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894299776:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767319126.212283:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319126.212290:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767319126.212293:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319126.212301:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4352 00000100:00080000:2.0:1767319126.212310:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319126.212317:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767319126.212350:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894300928/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767319126.212378:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319126.212381:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319126.212396:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319126.212404:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4373 00000100:00080000:2.0:1767319126.212408:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319126.212412:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319126.212420:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319126.212431:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894301056/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319126.212518:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894300928:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767319126.212609:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894301056:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319126.212868:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894301184:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319126.216394:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894301184:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319126.216455:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319126.216463:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319126.216467:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894301056:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319127.044291:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319127.108364:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319128.069049:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319128.132485:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319129.092754:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319129.156465:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319130.117838:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319130.180743:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319131.140175:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319131.204917:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319131.332592:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319131.332599:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319131.332602:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319131.332606:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319131.332610:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319131.332619:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4377 00000100:00080000:0.0:1767319131.332630:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319131.332648:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319131.333990:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319131.334034:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894301312/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319131.334139:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894301440:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319131.335362:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894301312:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319131.343159:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319131.343173:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319131.343177:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894301312:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319131.343917:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894301440:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319132.164287:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319132.229055:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319133.188217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319133.252909:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319134.214132:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319134.276976:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319135.237173:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319135.301307:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319136.260230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319136.324631:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319136.453105:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319136.453115:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319136.453118:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319136.453121:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319136.453125:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319136.453134:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4382 00000100:00080000:3.0:1767319136.453144:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319136.453153:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319136.453164:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319136.453201:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894301568/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319136.453268:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319136.453280:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894301696:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319136.454704:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894301568:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319136.465729:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894301696:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319136.466906:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319136.466915:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319136.466920:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894301568:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319137.284945:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319137.348593:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319138.308608:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319138.374156:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319139.332451:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319139.396389:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319140.356241:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319140.420480:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319141.380211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319141.444386:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319141.577793:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319141.577802:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319141.577804:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319141.577807:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319141.577811:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319141.577819:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4387 00000100:00080000:0.0:1767319141.577826:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319141.577832:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319141.577841:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319141.577872:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894301824/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319141.578669:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894301952:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319141.579945:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894301824:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767319141.586486:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319141.586498:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319141.586502:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894301824:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319141.586832:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894301952:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319142.404220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319142.468298:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319143.428274:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319143.492272:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319144.453297:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319144.516448:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319145.479871:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319145.540319:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319146.500381:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319146.564408:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319146.692617:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319146.692633:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319146.692636:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319146.692640:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319146.692644:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319146.692668:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4392 00000100:00080000:3.0:1767319146.692679:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319146.692685:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319146.692701:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319146.692746:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894302080/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319146.692832:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894302208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319146.693108:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894302080:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319146.704590:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894302208:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319146.704889:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319146.704896:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319146.704900:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894302080:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319147.524204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319147.588812:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319148.548346:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319148.613155:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319149.572267:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319149.636339:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319150.597418:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319150.660824:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319151.620589:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319151.684380:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319151.812272:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319126/real 1767319126] req@ffff9cfe29109c00 x1853163894300928/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319151 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319151.812305:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29109c00 x1853163894300928/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319151 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767319151.812318:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319151.812324:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319151.812327:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319151.812331:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319151.812335:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319151.812341:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4398 00000100:00080000:3.0:1767319151.812350:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319151.812357:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319151.812369:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319151.812402:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6d80 x1853163894302336/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319151.812483:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319151.812497:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894302464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319151.820059:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894302464:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319151.820092:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319151.820115:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767319151.820120:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894300928:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767319151.820147:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894302336:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319151.820147:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319151.820152:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319151.820154:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319151.820159:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4377 00000100:00080000:1.0:1767319151.820164:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319151.820171:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767319151.820209:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1c00 x1853163894302592/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319151.820239:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894302592:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767319151.825413:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319151.825428:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319151.825442:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894302336:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319152.644212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319152.708792:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319153.668219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319153.733209:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319154.692312:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319154.757429:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319155.716194:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319155.785791:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319156.740213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319156.804640:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319156.932301:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319156.932309:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319156.932311:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319156.932313:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319156.932316:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319156.932325:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4403 00000100:00080000:1.0:1767319156.932335:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319156.932341:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319156.932350:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319156.932396:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2d80 x1853163894302720/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319156.932476:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894302848:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319156.932643:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894302720:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319156.940774:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319156.940789:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319156.940795:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894302720:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319156.941005:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894302848:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319157.764512:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319157.828429:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319158.788727:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319158.852439:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319159.812245:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319159.876391:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319160.836208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319160.900324:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319161.860308:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319161.924377:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319162.054205:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319162.054214:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319162.054217:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319162.054221:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319162.054225:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319162.054235:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4408 00000100:00080000:3.0:1767319162.054245:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319162.054252:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319162.054264:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319162.054303:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894302976/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319162.054385:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319162.054404:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894303104:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319162.055501:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894302976:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319162.058467:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894303104:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319162.067968:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319162.067983:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319162.067988:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894302976:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319162.884425:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319162.948284:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319163.908237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319163.974064:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319164.932709:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319164.996433:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319165.956308:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319166.021278:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319166.980197:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319167.044344:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319167.172520:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319167.172528:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319167.172531:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319167.172535:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319167.172539:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319167.172549:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4413 00000100:00080000:1.0:1767319167.172558:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319167.172566:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319167.172580:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319167.172616:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2680 x1853163894303232/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319167.172709:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894303232:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319167.172838:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894303360:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319167.176834:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894303360:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319167.176836:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319167.176843:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319167.176861:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894303232:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319168.004228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319168.068553:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319169.028592:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319169.093978:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319170.052210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319170.116464:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319171.076156:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319171.140319:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319172.100204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319172.164380:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319172.292374:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319172.292385:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319172.292388:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319172.292391:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319172.292395:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319172.292405:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4418 00000100:00080000:0.0:1767319172.292414:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319172.292420:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319172.292432:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319172.292468:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8700 x1853163894303488/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319172.292554:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319172.292568:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894303616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319172.292721:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894303488:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319172.322712:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319172.322730:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319172.322736:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894303488:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319172.323057:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894303616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319173.127735:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319173.189482:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319174.149208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319174.213059:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319175.172336:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319175.237336:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319176.196207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319176.260817:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319176.388257:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319151/real 1767319151] req@ffff9cfe0f3d1c00 x1853163894302592/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319176 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319176.388294:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d1c00 x1853163894302592/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319176 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319176.388661:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319176.388780:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767319176.388785:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894302592:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767319176.389105:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319176.389111:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767319176.389114:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319176.389140:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4403 00000100:00080000:2.0:1767319176.389149:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319176.389156:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767319176.389188:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894303744/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767319176.389215:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319176.389218:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319176.389220:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319176.389234:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4423 00000100:00080000:2.0:1767319176.389237:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319176.389241:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319176.389250:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319176.389262:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894303872/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319176.389314:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319176.390119:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894303744:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767319176.390239:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894303872:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319176.390771:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894304000:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319176.401957:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894304000:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319176.402376:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319176.402463:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319176.402468:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894303872:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319177.220292:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319177.284400:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319178.244343:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319178.308659:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319179.268569:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319179.338578:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319180.292290:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319180.356666:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319181.316268:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319181.384287:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319181.512431:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319181.512450:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319181.512453:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319181.512458:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319181.512465:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319181.512480:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4427 00000100:00080000:3.0:1767319181.512497:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319181.512508:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319181.512527:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319181.512579:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894304128/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319181.512761:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894304128:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319181.512851:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894304256:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319181.524827:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319181.524865:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319181.524872:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894304128:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319181.525238:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894304256:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319182.340286:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319182.404757:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319183.364377:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319183.432345:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319184.389914:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319184.452617:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319185.413512:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319185.479708:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319186.436274:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319186.503925:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319186.633771:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319186.633800:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319186.633824:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319186.633829:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319186.633834:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319186.633846:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4432 00000100:00080000:2.0:1767319186.633857:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319186.633866:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319186.633878:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319186.633969:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894304384/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319186.635023:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894304384:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319186.635838:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894304512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319186.643852:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894304512:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319186.643969:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319186.643974:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319186.643977:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894304384:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319187.460301:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319187.526805:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319188.484780:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319188.548437:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319189.512523:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319189.575899:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319190.532426:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319190.596289:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319191.556372:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319191.621534:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319191.748435:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319191.748447:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319191.748450:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319191.748455:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319191.748459:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319191.748469:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4437 00000100:00080000:2.0:1767319191.748478:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319191.748485:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319191.748512:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319191.748543:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894304640/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319191.748622:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319191.748634:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894304768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319191.748893:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894304640:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319191.752462:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319191.752480:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319191.752485:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894304640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319191.752578:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894304768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319192.580634:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319192.644415:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319193.604632:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319193.668879:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319194.628199:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319194.692406:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319195.654471:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319195.716729:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319196.676250:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319196.740571:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319196.869070:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319196.869110:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319196.869133:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319196.869137:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319196.869142:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319196.869153:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4443 00000100:00080000:3.0:1767319196.869167:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319196.869176:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319196.869191:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319196.869229:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7100 x1853163894304896/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319196.869727:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894304896:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319196.870050:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894305024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319196.873342:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894305024:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319196.878183:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319196.878200:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319196.878205:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894304896:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319197.700801:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319197.766886:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319198.724220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319198.788334:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319199.748349:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319199.812308:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319200.772202:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319200.836281:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319201.796234:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319201.862366:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319201.988365:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319176/real 1767319176] req@ffff9cfe29109500 x1853163894303744/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319201 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319201.988403:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29109500 x1853163894303744/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319201 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319201.988423:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319201.988447:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767319201.988452:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894303744:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767319201.989415:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319201.989423:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319201.989427:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319201.989434:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4427 00000100:00080000:3.0:1767319201.989443:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319201.989451:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767319201.989484:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894305152/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319201.989514:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319201.989533:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319201.989535:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319201.989540:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4448 00000100:00080000:3.0:1767319201.989544:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319201.989548:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319201.989560:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319201.989572:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894305280/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319201.989622:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319201.989636:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894305408:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319201.990048:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894305152:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767319201.990118:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894305280:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319201.994129:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894305408:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319201.994374:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319201.994382:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319201.994387:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894305280:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319202.820918:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319202.884636:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319203.845444:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319203.909829:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319204.868285:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319204.932426:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319205.892220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319205.957496:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319206.916226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319206.980870:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319207.108547:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319207.108558:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319207.108561:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319207.108565:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319207.108570:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319207.108581:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4453 00000100:00080000:3.0:1767319207.108592:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319207.108599:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319207.108611:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319207.108662:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894305536/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319207.108790:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894305664:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319207.108961:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894305536:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319207.116153:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319207.116173:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319207.116180:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894305536:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319207.118555:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894305664:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319207.940637:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319208.007313:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319208.966897:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319209.029693:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319209.988258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319210.053386:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319211.012275:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319211.076397:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319212.037411:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319212.103865:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319212.230680:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319212.230692:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319212.230695:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319212.230700:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319212.230706:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319212.230746:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4458 00000100:00080000:2.0:1767319212.230761:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319212.230770:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319212.230784:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319212.230826:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894305792/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319212.230930:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319212.230953:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894305920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319212.231214:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894305792:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319212.236188:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319212.236211:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319212.236217:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894305792:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319212.237258:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894305920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319213.062736:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319213.124439:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319214.086173:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319214.148564:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319215.108373:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319215.172781:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319216.132200:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319216.201069:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319217.156235:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319217.220649:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319217.348628:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319217.348639:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319217.348643:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319217.348647:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319217.348653:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319217.348666:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4463 00000100:00080000:2.0:1767319217.348681:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319217.348691:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319217.348708:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319217.348753:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894306048/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319217.348861:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894306176:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319217.349038:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894306048:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319217.362455:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319217.362480:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319217.362487:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894306048:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319217.362618:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894306176:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319218.180239:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319218.245896:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319219.205046:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319219.276414:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319220.228211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319220.299179:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319221.252240:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319221.316329:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319222.276410:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319222.341113:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319222.468741:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319222.468771:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319222.468775:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319222.468779:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319222.468785:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319222.468799:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4468 00000100:00080000:2.0:1767319222.468819:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319222.468828:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319222.468844:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319222.468894:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894306304/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319222.468964:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319222.468988:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894306432:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319222.469483:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894306304:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319222.483464:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319222.483486:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319222.483493:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894306304:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319222.483740:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894306432:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319223.300702:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319223.364728:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319224.325413:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319224.388260:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319225.350063:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319225.412808:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319226.372207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319226.436444:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319226.564234:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319201/real 1767319201] req@ffff9cfe18fd4e00 x1853163894305152/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319226 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319226.564291:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd4e00 x1853163894305152/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319226 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767319226.564310:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319226.564338:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767319226.564343:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894305152:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767319226.564631:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319226.564637:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319226.564640:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319226.564646:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4453 00000100:00080000:3.0:1767319226.564655:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319226.564661:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767319226.564689:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6680 x1853163894306560/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319226.564719:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319226.564723:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319226.564725:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319226.564729:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4473 00000100:00080000:3.0:1767319226.564733:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319226.564738:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319226.564748:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319226.564754:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894306560:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767319226.564772:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894306688/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319226.564821:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894306816:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319226.566556:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894306688:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319226.568813:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894306816:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319226.576002:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319226.576016:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319226.576021:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894306688:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319227.396205:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319227.460668:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319228.420258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319228.487843:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319229.446878:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319229.508849:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319230.473190:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319230.532504:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319231.493194:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319231.556303:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319231.684766:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319231.684777:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319231.684780:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319231.684784:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319231.684788:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319231.684798:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4477 00000100:00080000:3.0:1767319231.684822:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319231.684829:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319231.684859:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319231.684889:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894306944/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319231.685018:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894307072:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319231.685916:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894306944:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319231.691398:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894307072:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319231.694337:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319231.694355:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319231.694360:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894306944:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319232.516230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319232.580756:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319233.541480:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319233.604319:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319234.564510:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319234.628416:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319235.588949:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319235.652471:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319236.612245:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319236.681299:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319236.804289:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319236.804300:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319236.804303:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319236.804307:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319236.804313:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319236.804323:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4483 00000100:00080000:3.0:1767319236.804335:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319236.804355:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319236.804367:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319236.804400:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894307200/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319236.804464:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319236.804475:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894307328:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319236.804632:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894307200:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319236.810741:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319236.810764:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319236.810770:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894307200:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319236.811785:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894307328:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319237.636330:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319237.702838:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319238.660245:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319238.724333:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319239.684216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319239.748475:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319240.708216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319240.772359:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319241.732511:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319241.796330:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319241.924375:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319241.924386:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319241.924389:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319241.924392:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319241.924397:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319241.924407:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4488 00000100:00080000:3.0:1767319241.924416:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319241.924424:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319241.924437:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319241.924470:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894307456/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319241.924498:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894307456:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319241.924537:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319241.924550:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894307584:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319241.928256:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319241.928270:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319241.928275:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894307456:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319241.928474:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894307584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319242.756274:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319242.821510:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319243.780234:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319243.844473:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319244.804192:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319244.869137:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319245.828209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319245.896549:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319246.852211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319246.916443:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319247.044730:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319247.044758:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319247.044761:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319247.044765:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319247.044769:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319247.044781:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4493 00000100:00080000:3.0:1767319247.044792:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1767319247.044800:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319247.044811:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319247.044843:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894307712/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319247.044914:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319247.044930:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894307840:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319247.045448:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894307712:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319247.047262:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894307840:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319247.059258:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319247.059276:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319247.059282:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894307712:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319247.876211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319247.940534:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319248.900258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319248.964322:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319249.926058:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319249.988275:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319250.948225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319251.012603:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319251.142962:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319226/real 1767319226] req@ffff9cfe18fd6680 x1853163894306560/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319251 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319251.142997:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd6680 x1853163894306560/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319251 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319251.143018:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319251.143044:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767319251.143048:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894306560:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767319251.143117:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319251.143123:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319251.143126:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319251.143131:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4477 00000100:00080000:3.0:1767319251.143140:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319251.143147:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767319251.143191:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894307968/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319251.143272:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894307968:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767319251.143385:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319251.143390:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319251.143393:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319251.143397:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4498 00000100:00080000:3.0:1767319251.143402:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1767319251.143407:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319251.143416:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319251.143429:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894308096/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319251.144447:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894308096:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319251.145689:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319251.145704:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894308224:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319251.147645:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894308224:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319251.147714:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319251.147718:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319251.147721:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894308096:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319251.972239:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319252.040043:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319252.996206:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319253.062642:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319254.020214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319254.085367:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319255.045694:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319255.108373:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319256.068161:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319256.132774:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319256.260316:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319256.260326:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319256.260329:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319256.260333:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319256.260337:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319256.260348:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4502 00000100:00080000:0.0:1767319256.260358:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1767319256.260366:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319256.260389:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319256.260426:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8380 x1853163894308352/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319256.260531:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894308480:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319256.260540:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894308352:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319256.262485:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319256.262507:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319256.262512:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894308352:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319256.263535:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894308480:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319257.092300:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319257.156410:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319258.116291:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319258.180331:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319259.143007:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319259.204408:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319260.164370:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319260.229510:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319261.188225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319261.252302:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319261.381771:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319261.381783:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319261.381806:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319261.381811:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319261.381815:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319261.381826:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4507 00000100:00080000:3.0:1767319261.381837:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319261.381844:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319261.381855:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319261.381887:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894308608/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319261.381960:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894308736:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319261.383126:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894308608:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319261.388843:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894308736:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319261.389169:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319261.389178:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319261.389183:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894308608:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319262.216224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319262.279256:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319263.236204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319263.301211:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319264.260323:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319264.326128:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319265.284253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319265.350107:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319266.308300:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319266.372346:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319266.500348:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319266.500361:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319266.500364:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319266.500369:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319266.500375:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319266.500388:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4512 00000100:00080000:3.0:1767319266.500412:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319266.500422:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319266.500437:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319266.500511:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894308864/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319266.500708:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894308992:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319266.501034:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894308864:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319266.511797:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894308992:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319266.512030:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319266.512037:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319266.512041:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894308864:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319267.333074:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319267.397027:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319268.356333:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319268.423832:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319269.380354:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319269.444973:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319270.404769:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319270.468534:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319271.429670:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319271.492292:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319271.620376:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319271.620386:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319271.620389:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319271.620392:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319271.620397:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319271.620407:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4517 00000100:00080000:0.0:1767319271.620423:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319271.620431:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319271.620444:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319271.620484:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fbb80 x1853163894309120/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319271.620552:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319271.620567:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894309248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319271.621122:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894309120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319271.629468:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894309248:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319271.642033:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319271.642050:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319271.642056:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894309120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319272.452211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319272.516323:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319273.476228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319273.541044:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319274.501048:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319274.564646:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319275.524244:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319275.589536:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319276.548208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319276.615897:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319276.755374:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319276.755385:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319276.755388:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319276.755392:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319276.755396:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319276.755406:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4522 00000100:00080000:3.0:1767319276.755418:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319276.755426:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319276.755438:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319276.755474:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894309376/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319276.755582:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319276.755600:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894309504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319276.760799:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319251/real 1767319251] req@ffff9cfe18fd7480 x1853163894307968/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319276 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319276.760837:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd7480 x1853163894307968/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319276 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319276.760861:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894309376:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319276.760968:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319276.760992:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767319276.760996:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894307968:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767319276.761115:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319276.761120:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319276.761123:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319276.761129:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4502 00000100:00080000:0.0:1767319276.761135:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319276.761141:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767319276.761168:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa680 x1853163894309632/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319276.761593:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894309632:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767319276.762753:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894309504:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319276.766229:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319276.766261:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319276.766267:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894309376:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319277.572265:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319277.636350:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319278.596566:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319278.660316:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319279.620710:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319279.684459:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319280.647777:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319280.708424:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319281.668213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319281.732408:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319281.861468:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319281.861479:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319281.861482:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319281.861486:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319281.861490:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319281.861501:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4528 00000100:00080000:0.0:1767319281.861511:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319281.861517:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319281.861528:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319281.861561:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fbb80 x1853163894309760/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319281.862203:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894309760:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319281.862469:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894309888:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319281.876764:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894309888:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319281.878276:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319281.878288:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319281.878293:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894309760:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319282.694119:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319282.758962:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319283.716761:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319283.780470:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319284.740346:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319284.806104:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319285.764246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319285.829043:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319286.788222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319286.857953:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319286.980485:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319286.980496:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319286.980499:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319286.980503:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319286.980507:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319286.980517:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4533 00000100:00080000:3.0:1767319286.980527:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319286.980534:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319286.980545:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319286.980582:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894310016/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319286.980690:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319286.980712:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894310144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319286.984691:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894310016:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319286.991603:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894310144:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319286.991919:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319286.991927:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319286.991930:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894310016:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319287.814562:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319287.879126:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319288.836342:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319288.900668:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319289.860261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319289.926636:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319290.884533:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319290.949288:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319291.908381:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319291.972711:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319292.103364:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319292.103380:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319292.103384:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319292.103389:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319292.103394:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319292.103408:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4538 00000100:00080000:0.0:1767319292.103422:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319292.103432:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319292.103448:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319292.103497:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8380 x1853163894310272/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319292.103587:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319292.103611:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894310400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319292.105719:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894310272:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319292.110246:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894310400:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319292.111291:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319292.111304:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319292.111308:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894310272:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319292.932286:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319292.997344:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319293.956207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319294.021472:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319294.980294:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319295.046565:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319296.004262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319296.068955:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319297.028227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319297.093057:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319297.220709:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319297.220720:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319297.220723:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319297.220727:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319297.220732:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319297.220743:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4543 00000100:00080000:0.0:1767319297.220753:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319297.220760:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319297.220772:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319297.220811:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8700 x1853163894310528/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319297.221128:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894310528:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319297.222176:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894310656:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319297.227490:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319297.227505:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319297.227511:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894310528:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319297.231922:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894310656:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319298.055547:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319298.125010:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319299.076298:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319299.140557:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319300.100241:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319300.164369:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319301.124261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319301.188329:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319301.316367:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319276/real 1767319276] req@ffff9cfe089fa680 x1853163894309632/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319301 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767319301.316404:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fa680 x1853163894309632/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319301 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767319301.316427:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319301.316449:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767319301.316453:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894309632:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767319301.320328:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319301.320341:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319301.320347:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319301.320357:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4528 00000100:00080000:0.0:1767319301.320369:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319301.320376:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767319301.320414:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894310784/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767319301.320448:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319301.320452:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319301.320477:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319301.320481:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4548 00000100:00080000:0.0:1767319301.320485:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319301.320489:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319301.320497:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319301.320510:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa300 x1853163894310912/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319301.320564:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319301.320585:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894311040:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319301.321015:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894310784:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767319301.321078:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894310912:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319301.333543:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894311040:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319301.337742:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319301.337756:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319301.337762:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894310912:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319302.148216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319302.212996:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319303.176208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319303.236460:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319304.198704:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319304.260362:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319305.220328:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319305.284800:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319306.248630:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319306.308615:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319306.436828:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319306.436838:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319306.436840:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319306.436844:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319306.436849:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319306.436860:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4552 00000100:00080000:2.0:1767319306.436870:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319306.436878:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319306.436889:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319306.436936:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894311168/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319306.437002:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894311296:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319306.437024:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894311168:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319306.443543:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894311296:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319306.443905:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319306.443924:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319306.443929:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894311168:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319307.268210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319307.332594:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319308.292220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319308.356720:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319309.316284:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319309.380658:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319310.343229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319310.404406:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319311.364195:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319311.429198:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319311.556894:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319311.556904:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319311.556918:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319311.556922:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319311.556927:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319311.556936:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4557 00000100:00080000:3.0:1767319311.556946:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319311.556952:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319311.556979:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319311.557175:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894311424/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319311.557241:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894311424:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319311.557386:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319311.557397:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894311552:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319311.561240:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894311552:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319311.561999:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319311.562009:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319311.562013:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894311424:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319312.388732:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319312.456388:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319313.412419:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319313.476413:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319314.437123:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319314.500317:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319315.460795:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319315.524389:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319316.486057:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319316.553439:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319316.677319:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319316.677333:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319316.677336:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319316.677342:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319316.677347:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319316.677360:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4562 00000100:00080000:0.0:1767319316.677373:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319316.677381:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319316.677396:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319316.677438:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9f80 x1853163894311680/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319316.677549:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767319316.677566:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894311808:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319316.677891:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894311680:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319316.702282:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894311808:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319316.777433:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319316.777452:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319316.777458:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894311680:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319317.509604:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319317.572664:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319318.532255:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319318.601564:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319319.556219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319319.620310:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319320.580232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319320.644285:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319321.604215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319321.668959:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319321.798554:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319321.798567:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319321.798570:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319321.798574:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319321.798579:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319321.798592:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4568 00000100:00080000:2.0:1767319321.798607:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319321.798616:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319321.798631:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319321.798684:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894311936/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319321.799171:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894312064:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319321.799323:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894311936:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319321.809406:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894312064:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319321.810212:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319321.810220:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319321.810225:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894311936:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319322.628250:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319322.694934:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319323.652196:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319323.718498:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319324.676737:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319324.742394:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319325.700312:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319325.766458:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319326.729378:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319326.788375:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319326.916309:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319326.916321:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319326.916323:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319326.916327:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319326.916332:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319326.916342:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4573 00000100:00080000:1.0:1767319326.916354:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319326.916363:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319326.916374:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319326.916415:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1c00 x1853163894312192/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319326.916528:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894312320:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319326.916565:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319301/real 1767319301] req@ffff9cfe089fad80 x1853163894310784/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319326 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319326.916588:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fad80 x1853163894310784/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319326 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319326.916606:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894312192:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767319326.916660:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319326.916676:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767319326.916680:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894310784:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767319326.916770:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319326.916773:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319326.916775:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319326.916779:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4552 00000100:00080000:1.0:1767319326.916783:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319326.916787:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767319326.916801:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0000 x1853163894312448/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319326.916957:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894312448:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767319326.922306:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319326.922330:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319326.922336:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894312192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319326.924010:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894312320:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319327.748769:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319327.812641:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319328.772246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319328.836360:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319329.796236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319329.860488:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319330.820286:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319330.884442:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319331.844237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319331.908593:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319332.036301:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319332.036343:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319332.036346:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319332.036351:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319332.036356:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319332.036371:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4578 00000100:00080000:1.0:1767319332.036388:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319332.036399:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319332.036418:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319332.036473:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0e00 x1853163894312576/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319332.036588:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767319332.036615:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894312704:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319332.037859:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894312576:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767319332.042380:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319332.042410:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319332.042419:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894312576:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319332.043402:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894312704:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319332.869141:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319332.932357:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319333.892266:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319333.958253:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319334.916512:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319334.980480:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319335.941498:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319336.004719:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319336.964261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319337.028392:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319337.156854:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319337.156900:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319337.156903:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319337.156908:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319337.156914:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319337.156929:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4583 00000100:00080000:0.0:1767319337.156942:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319337.156952:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319337.156968:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319337.157071:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9f80 x1853163894312832/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319337.157166:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894312832:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319337.158714:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319337.158738:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894312960:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319337.165066:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319337.165133:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319337.165140:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894312832:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319337.170180:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894312960:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319337.988418:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319338.052907:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319339.012716:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319339.077294:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319340.037453:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319340.100824:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319341.060409:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319341.124362:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319342.085180:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319342.149186:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319342.276317:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319342.276331:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319342.276335:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319342.276340:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319342.276346:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319342.276361:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4588 00000100:00080000:1.0:1767319342.276376:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319342.276385:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319342.276401:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319342.276485:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3480 x1853163894313088/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319342.276558:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894313088:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319342.277063:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894313216:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319342.284365:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894313216:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319342.285627:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319342.285665:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319342.285671:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894313088:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319343.108637:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319343.172654:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319344.132252:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319344.197614:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319345.156255:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319345.221669:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319346.180288:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319346.244376:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319347.204421:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319347.268322:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319347.399999:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319347.400016:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319347.400020:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319347.400051:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319347.400056:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319347.400070:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4593 00000100:00080000:0.0:1767319347.400115:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319347.400125:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319347.400142:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319347.400210:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9180 x1853163894313344/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319347.400299:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319347.400320:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894313472:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319347.400440:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894313344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319347.406783:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894313472:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319347.408835:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319347.408859:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319347.408865:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894313344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319348.229930:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319348.292455:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319349.253310:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319349.316510:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319350.276370:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319350.340599:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319351.301268:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319351.364390:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319351.492285:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319326/real 1767319326] req@ffff9cfe0f3d0000 x1853163894312448/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319351 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319351.492336:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0000 x1853163894312448/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319351 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767319351.492364:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319351.492465:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767319351.492470:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894312448:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767319351.499272:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319351.499289:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319351.499295:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319351.499309:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4578 00000100:00080000:0.0:1767319351.499324:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319351.499333:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767319351.499391:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb800 x1853163894313600/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767319351.499435:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319351.499439:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319351.499466:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319351.499472:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4598 00000100:00080000:0.0:1767319351.499476:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319351.499481:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319351.499493:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319351.499505:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8a80 x1853163894313728/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319351.499643:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894313856:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319351.499850:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894313600:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767319351.499892:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894313728:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767319351.513288:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319351.513309:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319351.513339:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894313728:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319351.513433:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894313856:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319352.324289:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319352.388428:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319353.348327:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319353.414994:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319354.372260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319354.437153:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319355.396324:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319355.466857:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319356.420269:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319356.484712:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319356.612948:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319356.612959:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319356.612962:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319356.612966:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319356.612989:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319356.613001:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4602 00000100:00080000:3.0:1767319356.613014:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319356.613022:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319356.613035:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319356.613070:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6d80 x1853163894313984/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319356.613328:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894314112:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319356.614482:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894313984:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319356.621136:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894314112:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319356.622150:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319356.622162:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319356.622166:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894313984:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319357.446358:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319357.508360:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319358.469146:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319358.532484:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319359.492295:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319359.556809:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319360.516222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319360.580349:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319361.540217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319361.604806:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319361.732271:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319361.732281:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319361.732284:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319361.732288:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319361.732292:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319361.732302:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4607 00000100:00080000:2.0:1767319361.732312:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319361.732318:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319361.732330:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319361.732367:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894314240/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319361.732450:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319361.732463:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894314368:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319361.732771:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894314240:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319361.747573:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319361.747587:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319361.747592:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894314240:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319361.747902:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894314368:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319362.564231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319362.628404:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319363.589569:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319363.653034:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319364.612228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319364.677357:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319365.636220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319365.700415:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319366.660389:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319366.724472:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319366.852234:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319366.852246:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319366.852250:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319366.852253:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319366.852258:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319366.852270:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4613 00000100:00080000:2.0:1767319366.852282:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319366.852290:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319366.852304:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319366.852350:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894314496/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319366.852627:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894314496:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319366.854621:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894314624:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319366.857037:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319366.857054:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319366.857060:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894314496:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319366.862408:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894314624:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319367.684231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319367.748484:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319368.708609:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319368.772378:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319369.732352:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319369.802047:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319370.756823:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319370.820627:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319371.780202:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319371.848167:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319371.972371:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319371.972383:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319371.972386:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319371.972398:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319371.972403:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319371.972420:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4618 00000100:00080000:2.0:1767319371.972478:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319371.972486:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319371.972500:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319371.972531:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910a680 x1853163894314752/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319371.972640:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894314880:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319371.972786:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894314752:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319371.980259:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894314880:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319371.985565:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319371.985579:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319371.985583:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894314752:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319372.804232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319372.868821:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319373.828176:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319373.892608:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319374.854452:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319374.916740:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319375.876237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319375.940380:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319376.070014:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319351/real 1767319351] req@ffff9cfe089fb800 x1853163894313600/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319376 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319376.070047:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fb800 x1853163894313600/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319376 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767319376.070066:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319376.070109:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767319376.070114:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894313600:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767319376.070198:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319376.070203:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319376.070206:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319376.070211:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4602 00000100:00080000:3.0:1767319376.070220:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319376.070225:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767319376.070259:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6d80 x1853163894315008/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319376.070286:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319376.070290:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319376.070291:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319376.070295:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4623 00000100:00080000:3.0:1767319376.070299:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319376.070303:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319376.070312:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319376.070335:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7100 x1853163894315136/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319376.070416:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894315264:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319376.075764:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894315008:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767319376.075873:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894315136:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319376.085329:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894315264:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319376.085512:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319376.085519:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319376.085524:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894315136:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319376.900778:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319376.966351:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319377.924254:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319377.988396:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319378.948230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319379.012368:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319379.975337:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319380.036412:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319380.999973:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319381.061854:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319381.191512:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319381.191521:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319381.191523:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319381.191526:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319381.191530:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319381.191539:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4627 00000100:00080000:0.0:1767319381.191548:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319381.191607:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319381.191619:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319381.191648:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8000 x1853163894315392/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319381.191731:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894315520:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319381.192559:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894315392:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319381.195109:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319381.195125:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319381.195129:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894315392:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319381.195444:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894315520:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319382.026925:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319382.084364:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319383.044240:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319383.109095:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319384.068540:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319384.132337:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319385.093219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319385.156704:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319386.117771:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319386.180388:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319386.308371:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894315648:192.168.202.121@tcp:17:kworker.0 00000100:00080000:1.0:1767319386.308505:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319386.308510:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319386.308514:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319386.308518:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319386.308522:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319386.308529:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4632 00000100:00080000:1.0:1767319386.308534:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319386.308542:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319386.308552:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319386.308569:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3480 x1853163894315776/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319386.308615:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319386.308624:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894315904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319386.310414:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894315776:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319386.328414:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894315904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319386.328439:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894315648:192.168.202.121@tcp:17:kworker.0 00000100:00080000:3.0:1767319386.328591:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319386.328598:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319386.328601:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894315776:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319387.142393:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319387.204546:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319388.164234:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319388.231843:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319389.188275:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319389.252590:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319390.213571:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319390.282666:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319391.236371:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319391.302495:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319391.428380:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319391.428395:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319391.428399:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319391.428403:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319391.428408:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319391.428422:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4637 00000100:00080000:3.0:1767319391.428459:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319391.428468:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319391.428482:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319391.428524:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894316032/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319391.428593:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894316160:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319391.428822:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894316032:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319391.436524:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319391.436542:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319391.436549:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894316032:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319391.441338:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894316160:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319392.260405:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319392.333171:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319393.284277:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319393.348576:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319394.309473:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319394.372366:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319395.332204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319395.398190:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319396.356376:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319396.424431:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319396.555352:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319396.555364:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319396.555368:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319396.555373:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319396.555380:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319396.555395:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4642 00000100:00080000:0.0:1767319396.555408:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319396.555418:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319396.555456:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319396.555500:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9880 x1853163894316288/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319396.555725:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894316416:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319396.555726:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894316288:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319396.576590:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319396.576618:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319396.576624:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894316288:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319396.583548:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894316416:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319397.380689:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319397.447836:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319398.404281:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319398.468647:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319399.428348:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319399.492700:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319400.452260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319400.521849:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319401.476246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319401.543970:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319401.669766:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319401.669777:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319401.669780:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319401.669784:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319401.669787:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319401.669798:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4647 00000100:00080000:0.0:1767319401.669809:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319401.669816:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319401.669841:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319401.669886:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8e00 x1853163894316544/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319401.669964:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319401.669989:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894316672:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319401.671712:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319376/real 1767319376] req@ffff9cfe18fd6d80 x1853163894315008/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319401 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319401.671739:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd6d80 x1853163894315008/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319401 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319401.671757:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894316544:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319401.672024:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319401.672046:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767319401.672050:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894315008:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767319401.674279:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319401.674289:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319401.674310:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319401.674320:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4627 00000100:00080000:0.0:1767319401.674329:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319401.674336:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767319401.674370:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb100 x1853163894316800/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319401.677533:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894316800:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767319401.682581:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894316672:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319401.687965:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319401.687979:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319401.687985:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894316544:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319402.500367:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319402.567829:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319403.525383:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319403.589743:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319404.549336:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319404.612620:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319405.572868:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319405.636560:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319406.596422:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319406.660506:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319406.788395:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319406.788403:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319406.788406:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319406.788408:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319406.788427:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319406.788436:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4653 00000100:00080000:3.0:1767319406.788444:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319406.788449:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319406.788460:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319406.788490:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894316928/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319406.788574:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894316928:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319406.788703:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319406.788710:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894317056:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319406.800188:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319406.800200:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319406.800204:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894316928:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319406.800283:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894317056:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319407.620707:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319407.684456:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319408.644337:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319408.708755:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319409.668264:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319409.733389:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319410.692581:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319410.757169:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319411.716249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319411.787296:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319411.908329:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319411.908338:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319411.908342:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319411.908345:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319411.908350:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319411.908360:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4658 00000100:00080000:3.0:1767319411.908371:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319411.908378:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319411.908389:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319411.908442:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894317184/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319411.908524:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894317312:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319411.909066:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894317184:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319411.921618:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319411.921632:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319411.921636:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894317184:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319411.921979:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894317312:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319412.740267:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319412.804320:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319413.764220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319413.828356:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319414.788441:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319414.852265:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319415.813126:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319415.877612:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319416.836970:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319416.903650:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319417.028735:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319417.028748:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319417.028751:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319417.028754:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319417.028758:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319417.028771:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4663 00000100:00080000:2.0:1767319417.028806:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319417.028827:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319417.028842:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319417.028880:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894317440/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319417.028947:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319417.028963:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894317568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319417.029177:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894317440:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319417.043409:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319417.043425:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319417.043431:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894317440:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319417.045597:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894317568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319417.861841:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319417.925045:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319418.884306:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319418.949119:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319419.908313:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319419.973124:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319420.933457:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319420.996666:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319421.956303:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319422.020533:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319422.148399:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319422.148410:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319422.148413:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319422.148417:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319422.148422:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319422.148433:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4668 00000100:00080000:0.0:1767319422.148443:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319422.148450:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319422.148463:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319422.148501:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9500 x1853163894317696/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319422.148646:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894317824:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319422.149622:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894317696:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767319422.152783:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1767319422.152790:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894317824:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319422.152798:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319422.152806:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894317696:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319422.980230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319423.044361:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319424.006293:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319424.068484:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319425.028267:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319425.092782:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319426.052354:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319426.118278:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319426.244348:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319401/real 1767319401] req@ffff9cfe089fb100 x1853163894316800/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319426 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319426.244397:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fb100 x1853163894316800/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319426 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319426.244427:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319426.244526:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767319426.244532:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894316800:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767319426.247835:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319426.247852:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767319426.247859:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319426.247873:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4653 00000100:00080000:2.0:1767319426.247889:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319426.247899:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767319426.247967:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894317952/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767319426.248013:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319426.248017:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319426.248020:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319426.248056:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4673 00000100:00080000:2.0:1767319426.248062:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319426.248068:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319426.248098:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319426.248113:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894318080/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319426.248333:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894318208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319426.248619:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894317952:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767319426.248759:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894318080:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319426.269182:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894318208:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319426.269675:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319426.269684:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319426.269689:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894318080:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319427.077595:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319427.142552:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319428.100525:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319428.164361:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319429.124332:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319429.190814:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319430.148593:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319430.216740:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319431.172481:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319431.236578:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319431.364624:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319431.364640:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319431.364644:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319431.364659:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319431.364665:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319431.364679:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4677 00000100:00080000:2.0:1767319431.364694:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319431.364704:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319431.364723:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319431.364784:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894318336/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319431.364878:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319431.364925:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894318464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319431.365644:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894318336:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319431.371001:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894318464:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319431.379221:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319431.379254:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319431.379260:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894318336:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319432.196581:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319432.260371:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319433.220337:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319433.287547:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319434.246920:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319434.308685:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319435.268401:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319435.332480:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319436.293471:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319436.357355:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319436.484500:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319436.484515:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319436.484519:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319436.484524:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319436.484530:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319436.484543:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4682 00000100:00080000:0.0:1767319436.484555:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319436.484565:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319436.484582:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319436.484647:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9880 x1853163894318592/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319436.484759:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894318720:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319436.486942:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894318592:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319436.493969:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894318720:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319436.495579:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319436.495615:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319436.495623:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894318592:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319437.316473:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319437.384614:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319438.340266:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319438.405435:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319439.364295:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319439.428624:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319440.388340:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319440.452478:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319441.412410:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319441.476671:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319441.605118:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319441.605138:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319441.605142:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319441.605147:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319441.605152:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319441.605166:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4687 00000100:00080000:3.0:1767319441.605182:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319441.605201:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319441.605245:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319441.605289:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894318848/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319441.605386:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894318976:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319441.605772:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894318848:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319441.629166:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319441.629190:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319441.629197:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894318848:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319441.629498:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894318976:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319442.436270:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319442.503390:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319443.460587:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319443.524390:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319444.484559:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319444.556050:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319445.508888:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319445.575563:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319446.532723:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319446.596411:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319446.724892:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319446.724917:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319446.724921:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319446.724926:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319446.724932:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319446.724946:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4692 00000100:00080000:3.0:1767319446.724959:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319446.724969:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319446.724993:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319446.725046:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894319104/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319446.725128:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894319104:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319446.725166:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894319232:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319446.741842:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319446.741866:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319446.741873:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894319104:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319446.743315:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894319232:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319447.556179:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319447.620633:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319448.581043:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319448.644363:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319449.604565:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319449.670431:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319450.629150:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319450.692598:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319451.652190:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319451.716561:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319451.844371:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319426/real 1767319426] req@ffff9cfe29108a80 x1853163894317952/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319451 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319451.844443:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29108a80 x1853163894317952/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319451 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319451.844463:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319451.844472:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767319451.844475:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894317952:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767319451.844651:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319451.844657:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319451.844661:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319451.844666:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4677 00000100:00080000:1.0:1767319451.844675:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319451.844681:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767319451.844722:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0000 x1853163894319360/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767319451.844747:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319451.844751:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319451.844753:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319451.844757:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4698 00000100:00080000:1.0:1767319451.844761:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319451.844764:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319451.844781:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319451.844794:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1880 x1853163894319488/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319451.844849:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767319451.844863:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894319616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319451.845126:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894319360:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767319451.845159:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894319488:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319451.851832:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319451.851846:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319451.851850:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894319488:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319451.852131:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894319616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319452.676206:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319452.740681:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319453.700173:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319453.765176:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319454.724281:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319454.788768:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319455.748355:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319455.812974:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319456.773367:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319456.839494:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319456.964331:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319456.964343:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319456.964346:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319456.964349:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319456.964354:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319456.964364:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4703 00000100:00080000:3.0:1767319456.964373:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319456.964380:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319456.964390:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319456.964424:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894319744/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319456.964513:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894319872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319456.964829:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894319744:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319456.966904:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319456.966918:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319456.966922:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894319744:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319456.967195:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894319872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319457.799569:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319457.867250:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319458.821855:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319458.884592:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319459.844292:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319459.908794:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319460.868221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319460.932916:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319461.892978:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319461.956399:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319462.084941:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319462.084951:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319462.084954:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319462.084958:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319462.084962:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319462.084972:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4708 00000100:00080000:1.0:1767319462.084981:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319462.084987:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319462.084997:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319462.085028:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0e00 x1853163894320000/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319462.085118:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894320128:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319462.085966:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894320000:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319462.088346:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894320128:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319462.091912:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319462.091924:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319462.091928:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894320000:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319462.916212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319462.981801:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319463.942641:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319464.004401:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319464.964992:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319465.028439:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319465.988201:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319466.052382:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319467.013745:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319467.076517:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319467.204713:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319467.204725:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319467.204728:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319467.204732:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319467.204737:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319467.204749:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4713 00000100:00080000:3.0:1767319467.204758:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319467.204765:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319467.204776:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319467.204812:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894320256/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319467.204893:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319467.204913:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894320384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319467.205068:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894320256:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319467.209235:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319467.209251:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319467.209257:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894320384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319467.209259:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894320256:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319468.037127:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319468.100781:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319469.060209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319469.124653:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319470.084200:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319470.148289:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319471.110921:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319471.172480:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319472.132214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319472.197608:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319472.324730:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319472.324739:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319472.324742:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319472.324746:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319472.324750:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319472.324759:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4718 00000100:00080000:2.0:1767319472.324768:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319472.324775:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319472.324786:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319472.324815:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894320512/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319472.324875:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319472.324879:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894320512:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319472.324886:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894320640:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319472.334596:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319472.334605:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319472.334611:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894320512:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319472.334899:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894320640:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319473.156320:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319473.221548:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319474.180198:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319474.244503:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319475.204231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319475.272951:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319476.228343:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319476.295024:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319476.420359:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319451/real 1767319451] req@ffff9cfe0f3d0000 x1853163894319360/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319476 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319476.420394:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0000 x1853163894319360/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319476 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767319476.420431:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319476.420460:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767319476.420465:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894319360:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767319476.420577:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319476.420594:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319476.420604:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319476.420610:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4703 00000100:00080000:1.0:1767319476.420619:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319476.420627:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767319476.420658:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0700 x1853163894320768/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767319476.420686:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319476.420690:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319476.420692:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319476.420696:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4723 00000100:00080000:1.0:1767319476.420699:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319476.420703:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319476.420713:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319476.420725:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1c00 x1853163894320896/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319476.420779:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767319476.420792:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894321024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319476.421289:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894320768:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767319476.421346:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894320896:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767319476.426949:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319476.426964:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319476.426970:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894320896:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319476.428056:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894321024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319477.253772:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319477.316688:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319478.276212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319478.340773:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319479.300641:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319479.364313:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319480.324263:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319480.388436:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319481.348208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319481.412532:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319481.540575:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319481.540585:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319481.540589:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319481.540592:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319481.540596:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319481.540606:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4727 00000100:00080000:2.0:1767319481.540624:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319481.540632:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319481.540643:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319481.540677:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894321152/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319481.540764:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319481.540781:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894321280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319481.541634:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894321152:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319481.549032:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894321280:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319481.562396:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319481.562413:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319481.562419:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894321152:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319482.372422:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319482.436270:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319483.398927:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319483.460491:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319484.420356:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319484.484421:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319485.444713:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319485.508622:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319486.468290:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319486.533788:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319486.661324:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319486.661334:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319486.661337:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319486.661341:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319486.661345:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319486.661354:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4732 00000100:00080000:2.0:1767319486.661364:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319486.661370:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319486.661381:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319486.661432:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894321408/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319486.661523:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894321408:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319486.662041:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319486.662054:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894321536:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319486.671855:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894321536:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319486.671953:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319486.671961:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319486.671964:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894321408:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319487.492931:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319487.556827:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319488.516221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319488.583594:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319489.540268:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319489.604676:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319490.564198:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319490.628457:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319491.588280:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319491.654797:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319491.780415:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319491.780424:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319491.780427:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319491.780431:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319491.780435:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319491.780444:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4738 00000100:00080000:3.0:1767319491.780453:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319491.780459:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319491.780468:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319491.780500:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6680 x1853163894321664/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319491.780553:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319491.780578:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894321792:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319491.782280:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894321664:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319491.793186:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894321792:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319491.796284:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319491.796299:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319491.796305:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894321664:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319492.613802:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319492.679681:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319493.637529:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319493.700625:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319494.660280:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319494.728770:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319495.684322:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319495.748613:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319496.710029:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319496.772796:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319496.900904:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319496.900917:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319496.900920:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319496.900924:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319496.900929:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319496.900941:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4743 00000100:00080000:2.0:1767319496.900952:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319496.900960:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319496.900974:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319496.901020:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894321920/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319496.901155:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319496.901170:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894322048:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319496.901376:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894321920:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319496.905643:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894322048:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319496.910146:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319496.910164:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319496.910171:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894321920:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319497.732735:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319497.798228:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319498.756385:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319498.821864:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319499.780254:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319499.844340:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319500.804335:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319500.870063:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319501.829018:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319501.892312:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319502.020370:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319502.020380:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319502.020383:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319502.020386:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319502.020391:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319502.020402:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4748 00000100:00080000:2.0:1767319502.020412:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319502.020419:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319502.020429:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319502.020471:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894322176/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319502.020539:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319502.020556:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894322304:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319502.020984:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319476/real 1767319476] req@ffff9cfe0f3d0700 x1853163894320768/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319501 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319502.021014:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0700 x1853163894320768/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319501 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319502.021028:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894322176:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319502.021102:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319502.021122:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767319502.021127:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894320768:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767319502.021300:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319502.021305:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319502.021308:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319502.021312:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4727 00000100:00080000:1.0:1767319502.021316:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319502.021320:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767319502.021351:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2680 x1853163894322432/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319502.021771:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894322432:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767319502.026973:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894322304:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319502.027626:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319502.027637:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319502.027642:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894322176:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319502.852203:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319502.917783:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319503.877533:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319503.942157:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319504.900643:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319504.964493:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319505.926677:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319505.988840:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319506.949648:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319507.012913:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319507.140491:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319507.140503:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319507.140507:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319507.140512:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319507.140517:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319507.140528:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4753 00000100:00080000:1.0:1767319507.140539:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319507.140547:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319507.140563:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319507.140612:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1500 x1853163894322560/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319507.140726:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894322688:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319507.141596:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894322560:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319507.146260:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319507.146277:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319507.146283:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894322560:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319507.146460:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894322688:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319507.972361:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319508.039389:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319508.997843:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319509.060650:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319510.021869:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319510.084504:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319511.049897:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319511.110182:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319512.068236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319512.133224:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319512.260227:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319512.260240:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319512.260244:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319512.260248:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319512.260253:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319512.260264:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4758 00000100:00080000:1.0:1767319512.260286:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319512.260311:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319512.260322:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319512.260502:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2d80 x1853163894322816/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319512.260579:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767319512.260598:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894322944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319512.261671:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894322816:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319512.270202:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319512.270218:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319512.270223:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894322816:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319512.270328:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894322944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319513.092905:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319513.156464:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319514.116214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319514.180621:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319515.141091:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319515.206018:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319516.164303:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319516.229566:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319517.188610:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319517.252507:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319517.380292:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319517.380322:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319517.380325:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319517.380329:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319517.380333:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319517.380343:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4763 00000100:00080000:2.0:1767319517.380353:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319517.380361:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319517.380374:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319517.380413:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894323072/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319517.380470:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894323072:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319517.380478:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319517.380497:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894323200:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319517.391047:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894323200:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319517.393042:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319517.393058:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319517.393064:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894323072:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319518.213705:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319518.276441:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319519.236481:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319519.305979:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319520.260421:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319520.324407:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319521.284216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319521.348982:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319522.308195:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319522.372922:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319522.502029:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319522.502040:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319522.502042:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319522.502046:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319522.502050:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319522.502060:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4768 00000100:00080000:2.0:1767319522.502096:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319522.502105:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319522.502135:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319522.502168:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894323328/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319522.502303:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894323456:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319522.502444:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894323328:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319522.508963:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319522.508993:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319522.508999:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894323328:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319522.509562:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894323456:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319523.332256:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319523.396415:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319524.358268:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319524.420721:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319525.380217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319525.444641:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319526.404244:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319526.473930:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319527.428465:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319527.493970:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319527.623357:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319527.623370:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319527.623373:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319527.623376:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319527.623381:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319527.623392:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4773 00000100:00080000:2.0:1767319527.623402:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319527.623409:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319527.623421:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319527.623454:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894323584/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319527.623527:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894323712:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319527.624216:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319502/real 1767319502] req@ffff9cfe0f3d2680 x1853163894322432/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319527 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767319527.624243:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d2680 x1853163894322432/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319527 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767319527.624259:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894323584:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767319527.624330:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319527.624346:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767319527.624351:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894322432:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767319527.624385:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319527.624390:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319527.624393:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319527.624397:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4753 00000100:00080000:3.0:1767319527.624414:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319527.624419:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767319527.624437:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4380 x1853163894323840/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319527.624466:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894323840:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767319527.625891:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894323712:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319527.630155:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319527.630172:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319527.630179:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894323584:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319528.452222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319528.516474:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319529.476604:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319529.542030:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319530.501243:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319530.565046:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319531.524338:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319531.591778:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319532.548231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319532.612522:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319532.742190:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319532.742199:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319532.742202:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319532.742205:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319532.742209:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319532.742219:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4778 00000100:00080000:3.0:1767319532.742229:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319532.742235:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319532.742255:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319532.742284:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6680 x1853163894323968/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319532.742345:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894324096:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319532.742766:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894323968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319532.759406:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894324096:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319532.763167:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319532.763183:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319532.763188:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894323968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319533.572199:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319533.636306:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319534.596271:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319534.660787:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319535.620362:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319535.684694:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319536.644217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319536.708548:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319537.669843:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319537.732582:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319537.860338:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319537.860348:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319537.860351:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319537.860355:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319537.860359:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319537.860370:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4784 00000100:00080000:3.0:1767319537.860380:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319537.860387:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319537.860398:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319537.860437:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894324224/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319537.860514:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319537.860529:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894324352:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319537.860866:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894324224:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319537.869877:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319537.869895:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319537.869900:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894324224:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319537.870039:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894324352:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319538.692217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319538.758215:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319539.717683:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319539.785316:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319540.743039:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319540.804502:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319541.768037:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319541.829061:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319542.789019:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319542.852331:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319542.981542:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319542.981553:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319542.981556:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319542.981560:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319542.981565:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319542.981576:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4789 00000100:00080000:1.0:1767319542.981587:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319542.981594:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319542.981605:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319542.981639:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3100 x1853163894324480/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319542.981700:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894324480:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319542.981864:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894324608:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319542.988987:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894324608:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319542.990121:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319542.990134:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319542.990140:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894324480:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319543.817030:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319543.876334:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319544.836748:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319544.900576:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319545.860882:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319545.924499:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319546.884226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319546.948956:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319547.908210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319547.972288:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319548.100319:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319548.100347:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319548.100349:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319548.100353:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319548.100356:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319548.100366:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4794 00000100:00080000:1.0:1767319548.100375:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319548.100382:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319548.100535:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319548.100577:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1f80 x1853163894324736/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319548.100740:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894324864:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319548.100915:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894324736:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319548.104946:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894324864:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319548.105052:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319548.105060:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319548.105065:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894324736:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319548.932170:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319548.997969:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319549.956226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319550.020269:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319550.982835:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319551.044494:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319552.004185:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319552.069454:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319552.196918:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319527/real 1767319527] req@ffff9cfe18fd4380 x1853163894323840/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319552 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319552.196953:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd4380 x1853163894323840/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319552 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319552.196972:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319552.196997:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767319552.197001:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894323840:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767319552.197069:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319552.197074:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319552.197077:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319552.197100:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4778 00000100:00080000:1.0:1767319552.197108:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319552.197114:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767319552.197147:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0380 x1853163894324992/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767319552.198033:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319552.198039:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319552.198041:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319552.198047:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4799 00000100:00080000:1.0:1767319552.198053:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319552.198076:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319552.198118:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319552.198136:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3800 x1853163894325120/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319552.198557:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894325248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319552.198696:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894324992:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767319552.198728:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894325120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319552.213387:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894325248:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319552.213482:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319552.213490:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319552.213494:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894325120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319553.028210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319553.092333:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319554.055964:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319554.116294:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319555.076227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319555.140286:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319556.100221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319556.167059:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319557.124216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319557.189519:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319557.316423:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319557.316434:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319557.316437:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319557.316441:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319557.316446:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319557.316456:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4803 00000100:00080000:2.0:1767319557.316465:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319557.316472:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319557.316482:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319557.316515:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894325376/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319557.316578:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319557.316591:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894325504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319557.317590:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894325376:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319557.321179:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894325504:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319557.321465:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319557.321471:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319557.321475:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894325376:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319558.150288:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319558.216773:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319559.172277:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319559.239107:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319560.196230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319560.260323:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319561.220420:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319561.284431:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319562.244238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319562.308514:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319562.437453:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319562.437464:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319562.437467:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319562.437470:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319562.437475:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319562.437484:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4808 00000100:00080000:1.0:1767319562.437495:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319562.437502:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319562.437514:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319562.437550:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1180 x1853163894325632/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319562.437711:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894325760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319562.440884:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894325632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319562.442534:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894325760:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319562.450794:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319562.450809:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319562.450814:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894325632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319563.270510:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319563.334604:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319564.292191:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319564.356410:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319565.316384:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319565.380275:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319566.340465:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319566.406117:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319567.364490:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319567.429935:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319567.556456:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319567.556465:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319567.556468:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319567.556472:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319567.556476:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319567.556485:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4813 00000100:00080000:3.0:1767319567.556495:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319567.556503:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319567.556513:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319567.556547:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894325888/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319567.556609:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894326016:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319567.557032:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894325888:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319567.559870:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894326016:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319567.560375:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319567.560381:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319567.560386:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894325888:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319568.388204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319568.452443:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319569.414464:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319569.476533:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319570.436427:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319570.501664:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319571.460219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319571.526895:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319572.484186:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319572.549568:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319572.680298:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319572.680308:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319572.680312:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319572.680316:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319572.682757:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319572.682769:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4818 00000100:00080000:2.0:1767319572.682893:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319572.682902:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319572.682914:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319572.682946:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894326144/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319572.683055:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894326272:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319572.683222:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894326144:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319572.686919:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319572.686934:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319572.686940:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894326144:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319572.687256:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894326272:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319573.510756:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319573.573617:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319574.535326:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319574.596631:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319575.556227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319575.620287:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319576.580238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319576.644658:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319577.604284:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319577.668277:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319577.796221:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1767319577.796236:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319552/real 1767319552] req@ffff9cfe0f3d0380 x1853163894324992/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319577 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767319577.796243:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319577.796247:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319577.796251:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319577.796255:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319577.796262:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4824 00000100:00080000:2.0:1767319577.796273:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319577.796279:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319577.796290:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319577.796322:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894326400/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319577.796387:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894326528:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319577.796480:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0380 x1853163894324992/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319577 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319577.796503:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894326400:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319577.796548:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319577.796584:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767319577.796589:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894324992:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767319577.796763:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319577.796768:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319577.796770:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319577.796774:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4803 00000100:00080000:0.0:1767319577.796778:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319577.796782:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767319577.796797:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb800 x1853163894326656/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319577.796944:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894326656:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767319577.799298:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894326528:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319577.800033:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319577.800041:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319577.800045:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894326400:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319578.629372:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319578.692684:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319579.652335:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319579.716759:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319580.676260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319580.743614:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319581.700248:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319581.766294:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319582.724240:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319582.789812:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319582.916757:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319582.916767:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319582.916770:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319582.916774:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319582.916778:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319582.916789:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4829 00000100:00080000:3.0:1767319582.916799:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319582.916807:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319582.916818:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319582.916856:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894326784/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319582.916909:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894326912:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319582.918073:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894326784:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319582.920387:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894326912:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319582.921618:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319582.921630:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319582.921646:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894326784:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319583.748611:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319583.812417:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319584.772457:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319584.839423:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319585.796204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319585.863919:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319586.820218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319586.885574:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319587.844215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319587.908362:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319588.036172:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319588.036186:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319588.036190:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319588.036194:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319588.036198:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319588.036209:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4834 00000100:00080000:3.0:1767319588.036219:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319588.036225:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319588.036236:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319588.036271:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894327040/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319588.036341:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894327168:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319588.036721:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894327040:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319588.039419:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319588.039433:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319588.039439:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894327040:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319588.040374:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894327168:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319588.868207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319588.934526:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319589.893822:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319589.956527:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319590.916382:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319590.980292:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319591.940248:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319592.005061:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319592.966785:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319593.032966:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319593.170139:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319593.170150:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319593.170153:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319593.170157:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319593.170161:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319593.170172:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4839 00000100:00080000:2.0:1767319593.170197:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319593.170228:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319593.171640:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319593.171684:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894327296/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319593.171784:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894327424:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319593.171937:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894327296:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319593.176988:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319593.177004:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319593.177010:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894327296:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319593.180255:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894327424:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319593.989356:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319594.057515:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319595.012296:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319595.076367:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319596.036220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319596.100488:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319597.061636:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319597.127172:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319598.084226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319598.148534:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319598.285954:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319598.285963:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319598.285967:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319598.285970:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319598.285974:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319598.285984:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4844 00000100:00080000:3.0:1767319598.285996:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319598.286016:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319598.286027:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319598.286059:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894327552/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319598.286162:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894327680:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319598.286165:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894327552:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319598.295807:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319598.295822:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319598.295827:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894327552:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319598.297451:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894327680:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319599.108146:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319599.172729:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319600.132213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319600.196777:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319601.156228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319601.220645:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319602.180252:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319602.247239:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319602.374414:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319577/real 1767319577] req@ffff9cfe089fb800 x1853163894326656/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319602 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319602.374481:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fb800 x1853163894326656/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319602 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319602.374501:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319602.374530:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767319602.374535:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894326656:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767319602.374883:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319602.374889:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319602.374892:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319602.374898:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4829 00000100:00080000:3.0:1767319602.374918:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319602.374924:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767319602.374954:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6d80 x1853163894327808/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319602.374993:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319602.374998:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319602.375000:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319602.375004:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4849 00000100:00080000:3.0:1767319602.375008:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319602.375012:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319602.375021:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319602.375034:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894327936/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319602.375142:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894327808:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767319602.375231:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894327936:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319602.375299:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319602.375309:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894328064:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319602.386968:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319602.386985:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319602.386992:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894327936:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319602.387053:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894328064:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319603.208110:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319603.268416:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319604.228224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319604.292314:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319605.252801:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319605.316254:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319606.276443:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319606.340560:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319607.300245:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319607.364870:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319607.492308:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319607.492325:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319607.492329:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319607.492333:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319607.492337:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319607.492348:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4853 00000100:00080000:1.0:1767319607.492358:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319607.492366:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319607.492378:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319607.492416:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0380 x1853163894328192/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319607.492502:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894328192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319607.492773:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894328320:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319607.509182:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319607.509198:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319607.509203:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894328192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319607.514872:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894328320:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319608.324268:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319608.388330:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319609.349197:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319609.412977:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319610.372206:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319610.442798:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319611.396868:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319611.460986:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319612.420315:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319612.485240:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319612.613914:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319612.613953:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319612.613956:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319612.613960:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319612.613985:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319612.613995:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4858 00000100:00080000:3.0:1767319612.614005:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319612.614012:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319612.614024:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319612.614268:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7100 x1853163894328448/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319612.614365:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894328576:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319612.615577:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894328448:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319612.630163:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319612.630180:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319612.630185:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894328448:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319612.632185:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894328576:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319613.444221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319613.509105:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319614.468196:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319614.532320:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319615.493831:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319615.556285:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319616.518361:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319616.583767:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319617.541951:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319617.605395:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319617.732632:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319617.732643:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319617.732646:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319617.732650:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319617.732654:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319617.732665:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4863 00000100:00080000:3.0:1767319617.732677:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319617.732684:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319617.732696:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319617.732738:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894328704/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319617.732873:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894328704:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319617.733169:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894328832:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319617.747344:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894328832:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319617.753602:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319617.753616:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319617.753621:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894328704:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319618.564277:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319618.628429:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319619.588235:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319619.654247:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319620.612322:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319620.677067:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319621.637142:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319621.700487:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319622.660271:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319622.725527:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319622.852384:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319622.852393:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319622.852397:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319622.852400:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319622.852405:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319622.852422:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4869 00000100:00080000:2.0:1767319622.852432:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319622.852439:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319622.852465:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319622.852494:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894328960/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319622.852562:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894328960:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319622.855508:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319622.855530:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894329088:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319622.858661:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319622.858684:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319622.858691:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894328960:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319622.861463:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894329088:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319623.685120:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319623.748317:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319624.708300:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319624.772569:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319625.732217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319625.797550:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319626.756224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319626.820417:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319627.780222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319627.845132:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319627.973784:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319602/real 1767319602] req@ffff9cfe18fd6d80 x1853163894327808/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319627 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319627.973816:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd6d80 x1853163894327808/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319627 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319627.973834:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319627.973843:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767319627.973847:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894327808:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767319627.974478:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319627.974483:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319627.974486:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319627.974492:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4853 00000100:00080000:0.0:1767319627.974501:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319627.974507:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767319627.974542:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb480 x1853163894329216/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767319627.974575:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319627.974580:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319627.974581:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319627.974585:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4874 00000100:00080000:0.0:1767319627.974588:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319627.974592:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319627.974601:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319627.974614:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8a80 x1853163894329344/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319627.974676:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894329472:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319627.975339:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894329216:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767319627.975393:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894329344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319627.994003:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894329472:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319627.997146:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319627.997162:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319627.997167:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894329344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319628.805758:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319628.868691:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319629.828256:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319629.896332:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319630.852522:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319630.916391:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319631.876336:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319631.940648:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319632.900221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319632.964651:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319633.092442:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319633.092452:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319633.092455:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319633.092458:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319633.092464:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319633.092473:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4879 00000100:00080000:0.0:1767319633.092483:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319633.092490:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319633.092502:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319633.092537:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9180 x1853163894329600/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319633.092602:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894329728:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319633.092863:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894329600:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319633.099682:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894329728:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319633.100938:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319633.100967:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319633.100972:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894329600:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319633.924232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319633.989236:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319634.949188:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319635.015020:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319635.972538:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319636.036335:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319636.996334:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319637.061847:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319638.020254:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319638.084484:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319638.212499:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319638.212528:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319638.212531:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319638.212534:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319638.212539:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319638.212557:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4884 00000100:00080000:2.0:1767319638.212569:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319638.212576:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319638.212589:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319638.212751:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894329856/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319638.212827:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319638.212842:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894329984:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319638.213110:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894329856:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319638.215927:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319638.215942:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319638.215948:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894329856:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319638.220726:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894329984:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319639.045058:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319639.110800:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319640.068555:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319640.132335:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319641.092178:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319641.156469:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319642.116386:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319642.180629:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319643.141685:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319643.204307:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319643.333625:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319643.333636:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319643.333640:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319643.333663:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319643.333668:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319643.333679:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4889 00000100:00080000:0.0:1767319643.333691:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319643.333698:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319643.333711:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319643.333742:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894330112/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319643.333826:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894330112:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319643.335782:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894330240:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319643.346216:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894330240:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319643.352349:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319643.352364:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319643.352370:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894330112:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319644.164555:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319644.234718:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319645.189478:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319645.252883:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319646.212348:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319646.279654:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319647.236267:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319647.300251:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319648.262190:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319648.324785:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319648.452249:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319648.452260:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319648.452263:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319648.452267:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319648.452271:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319648.452281:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4894 00000100:00080000:2.0:1767319648.452291:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319648.452297:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319648.452308:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319648.452341:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894330368/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319648.452434:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894330496:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319648.452552:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894330368:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319648.456446:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319648.456468:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319648.456474:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894330368:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319648.456741:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894330496:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319649.284257:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319649.351157:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319650.314129:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319650.373327:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319651.332656:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319651.396628:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319652.356264:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319652.420604:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319652.548249:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319627/real 1767319627] req@ffff9cfe089fb480 x1853163894329216/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319652 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319652.548306:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fb480 x1853163894329216/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319652 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319652.548325:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319652.548348:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767319652.548352:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894329216:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767319652.548500:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319652.548505:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767319652.548508:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319652.548513:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4879 00000100:00080000:2.0:1767319652.548522:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319652.548528:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767319652.548569:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894330624/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767319652.548602:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319652.548606:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319652.548608:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319652.548612:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4899 00000100:00080000:2.0:1767319652.548616:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319652.548620:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319652.548635:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319652.548652:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894330752/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319652.549156:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894330624:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767319652.549256:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894330752:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319652.549398:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894330880:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319652.566451:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894330880:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319652.568416:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319652.568431:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319652.568436:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894330752:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319653.380235:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319653.447451:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319654.406712:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319654.468437:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319655.428204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319655.493033:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319656.452266:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319656.519104:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319657.478196:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319657.545561:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319657.668207:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319657.668218:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319657.668221:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319657.668225:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319657.668230:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319657.668239:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4903 00000100:00080000:3.0:1767319657.668246:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319657.668252:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319657.668262:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319657.668292:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894331008/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319657.668387:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894331136:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319657.668392:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894331008:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319657.672141:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894331136:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319657.673696:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319657.673708:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319657.673713:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894331008:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319658.500208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319658.564817:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319659.528150:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319659.588418:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319660.548213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319660.612786:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319661.572225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319661.636238:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319662.596325:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319662.660427:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319662.790077:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319662.790114:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319662.790118:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319662.790121:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319662.790126:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319662.790135:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4909 00000100:00080000:0.0:1767319662.790162:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319662.790169:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319662.790180:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319662.790219:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa300 x1853163894331264/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319662.790282:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894331392:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319662.790718:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894331264:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319662.794480:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894331392:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319662.797999:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319662.798014:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319662.798019:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894331264:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319663.620212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319663.685760:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319664.644322:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319664.709025:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319665.668207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319665.735125:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319666.692192:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319666.757482:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319667.716413:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319667.781074:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319667.911647:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319667.911657:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319667.911660:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319667.911664:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319667.911668:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319667.911680:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4914 00000100:00080000:3.0:1767319667.911693:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319667.911700:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319667.911713:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319667.911816:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894331520/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319667.911902:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894331648:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319667.911921:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894331520:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319667.915994:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894331648:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319667.916379:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319667.916387:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319667.916392:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894331520:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319668.740482:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319668.804381:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319669.764422:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319669.828516:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319670.790071:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319670.852357:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319671.812313:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319671.877022:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319672.836346:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319672.902071:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319673.028299:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319673.028311:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319673.028314:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319673.028317:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319673.028321:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319673.028331:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4919 00000100:00080000:1.0:1767319673.028340:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319673.028348:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319673.028359:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319673.028396:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3b80 x1853163894331776/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319673.028435:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894331776:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319673.028524:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894331904:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319673.031893:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319673.031908:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319673.031913:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894331776:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319673.032195:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894331904:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319673.860836:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319673.924555:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319674.884289:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319674.948531:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319675.908174:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319675.973220:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319676.932449:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319676.996606:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319677.124317:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319652/real 1767319652] req@ffff9cfe29109180 x1853163894330624/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319677 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319677.124361:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29109180 x1853163894330624/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319677 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767319677.124380:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319677.124406:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767319677.124410:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894330624:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767319677.124481:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319677.124487:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319677.124490:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319677.124513:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4903 00000100:00080000:3.0:1767319677.124522:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319677.124528:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767319677.124557:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894332032/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319677.124580:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319677.124584:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319677.124585:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319677.124589:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4924 00000100:00080000:3.0:1767319677.124592:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319677.124596:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319677.124604:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319677.124616:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894332160/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319677.124671:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894332288:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319677.124994:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894332032:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767319677.125045:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894332160:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319677.128572:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894332288:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319677.131023:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319677.131048:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319677.131054:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894332160:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319677.956215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319678.023630:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319678.980215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319679.044310:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319680.004232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319680.068769:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319681.029590:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319681.092698:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319682.052225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319682.116340:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319682.244764:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319682.244775:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319682.244778:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319682.244782:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319682.244796:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319682.244807:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4928 00000100:00080000:3.0:1767319682.244817:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319682.244825:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319682.244854:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319682.244887:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894332416/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319682.244960:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894332544:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319682.245604:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894332416:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319682.250333:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319682.250349:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319682.250354:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894332416:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319682.255304:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894332544:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319683.076214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319683.141114:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319684.100212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319684.165265:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319685.129140:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319685.188578:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319686.148174:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319686.212358:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319687.172472:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319687.237285:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319687.365307:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319687.365319:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319687.365322:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319687.365326:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319687.365330:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319687.365340:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4933 00000100:00080000:0.0:1767319687.365351:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319687.365359:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319687.365392:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319687.365420:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089faa00 x1853163894332672/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319687.365492:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894332800:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319687.365860:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894332672:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319687.368313:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319687.368328:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319687.368333:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894332672:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319687.369169:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894332800:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319688.196231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319688.260334:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319689.221117:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319689.284350:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319690.244214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319690.312933:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319691.268224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319691.332272:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319692.292242:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319692.356334:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319692.484506:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319692.484528:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319692.484537:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319692.484541:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319692.484545:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319692.484556:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4938 00000100:00080000:2.0:1767319692.484565:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319692.484572:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319692.484583:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319692.484617:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894332928/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319692.484688:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319692.484701:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894333056:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319692.484982:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894332928:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319692.489989:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1767319692.489996:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894333056:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319692.490001:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319692.490009:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894332928:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319693.316895:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319693.381852:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319694.340202:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319694.406635:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319695.364791:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319695.431285:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319696.388590:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319696.452451:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319697.412671:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319697.476309:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319697.609178:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319697.609191:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319697.609209:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319697.609213:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319697.609218:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319697.609232:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4943 00000100:00080000:1.0:1767319697.609245:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319697.609254:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319697.609269:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319697.609311:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3b80 x1853163894333184/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319697.609421:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894333312:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319697.609506:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894333184:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319697.637926:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894333312:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319697.639008:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319697.639021:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319697.639025:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894333184:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319698.436246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319698.500325:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319699.460228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319699.524744:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319700.484701:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319700.548732:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319701.508375:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319701.572386:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319702.532284:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319702.598484:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319702.724244:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319702.724255:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319702.724258:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319702.724263:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1767319702.724263:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319677/real 1767319677] req@ffff9cfe18fd4a80 x1853163894332032/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319702 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319702.724269:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319702.724280:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4948 00000100:00080000:1.0:1767319702.724289:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319702.724296:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767319702.724300:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd4a80 x1853163894332032/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319702 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:1.0:1767319702.724311:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00080000:2.0:1767319702.724320:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319702.724342:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767319702.724347:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1180 x1853163894333440/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319702.724348:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894332032:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767319702.724378:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894333440:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319702.724408:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319702.724413:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319702.724415:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319702.724419:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4928 00000100:00080000:1.0:1767319702.724433:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319702.724438:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767319702.724450:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3800 x1853163894333696/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319702.724476:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319702.724485:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894333568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319702.724585:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894333696:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767319702.727028:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319702.727052:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319702.727071:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894333440:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319702.728548:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894333568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319703.556433:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319703.621981:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319704.580203:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319704.644338:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319705.604909:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319705.669910:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319706.628357:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319706.692481:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319707.652287:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319707.721521:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319707.844258:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319707.844269:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319707.844272:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319707.844275:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319707.844280:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319707.844290:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4954 00000100:00080000:0.0:1767319707.844299:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319707.844306:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319707.844318:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319707.844351:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa680 x1853163894333824/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319707.844436:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894333824:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319707.845158:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767319707.845171:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894333952:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319707.852912:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894333952:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319707.855273:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319707.855288:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319707.855293:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894333824:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319708.676221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319708.740346:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319709.701296:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319709.764290:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319710.725670:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319710.791821:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319711.748193:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319711.814140:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319712.772218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319712.838477:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319712.964374:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319712.964386:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319712.964389:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319712.964393:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319712.964398:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319712.964407:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4959 00000100:00080000:2.0:1767319712.964417:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319712.964424:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319712.964439:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319712.964476:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894334080/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319712.964605:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894334208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319712.964999:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894334080:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319712.978727:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894334208:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319712.980602:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319712.980616:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319712.980632:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894334080:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319713.796288:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319713.865204:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319714.820212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319714.885239:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319715.844262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319715.908397:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319716.868223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319716.946713:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319717.892183:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319717.959801:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319718.086867:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319718.086878:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319718.086881:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319718.086885:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319718.086889:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319718.086901:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4964 00000100:00080000:0.0:1767319718.086912:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319718.086920:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319718.086931:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319718.086966:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa680 x1853163894334336/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319718.087056:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894334464:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319718.089778:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894334336:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319718.094204:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894334464:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319718.096072:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319718.096110:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319718.096115:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894334336:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319718.917509:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319718.980396:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319719.944047:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319720.007181:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319720.964289:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319721.028446:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319721.988915:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319722.053129:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319723.012300:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319723.077528:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319723.204434:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319723.204443:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319723.204445:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319723.204448:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319723.204452:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319723.204460:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4969 00000100:00080000:1.0:1767319723.204468:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319723.204474:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319723.204482:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319723.204511:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1180 x1853163894334592/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319723.204614:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894334720:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319723.204629:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894334592:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319723.210037:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319723.210053:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319723.210059:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894334592:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319723.210360:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894334720:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319724.036214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319724.101594:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319725.060371:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319725.125824:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319726.084285:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319726.148351:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319727.108292:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319727.172352:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319727.300262:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319702/real 1767319702] req@ffff9cfe0f3d3800 x1853163894333696/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319727 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319727.300295:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d3800 x1853163894333696/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319727 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767319727.300314:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319727.300327:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767319727.300331:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894333696:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767319727.300343:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319727.300351:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319727.300354:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319727.300361:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4954 00000100:00080000:0.0:1767319727.300371:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319727.300377:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767319727.300411:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9c00 x1853163894334848/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767319727.300439:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319727.300443:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319727.300445:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319727.300449:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4974 00000100:00080000:0.0:1767319727.300452:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319727.300456:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319727.300464:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319727.300493:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8700 x1853163894334976/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319727.300542:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319727.300554:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894335104:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319727.300715:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894334848:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767319727.300748:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894334976:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319727.306190:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894335104:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319727.309858:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319727.309873:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319727.309878:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894334976:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319728.132297:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319728.196494:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319729.156247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319729.221039:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319730.180488:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319730.249566:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319731.204226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319731.271034:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319732.228881:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319732.297833:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319732.430362:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319732.430373:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319732.430376:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319732.430399:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319732.430403:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319732.430414:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4978 00000100:00080000:2.0:1767319732.430426:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319732.430433:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319732.430446:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319732.430493:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894335232/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319732.430530:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894335232:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319732.430694:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894335360:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319732.442389:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319732.442411:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319732.442417:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894335232:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319732.444432:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894335360:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319733.252337:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319733.316727:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319734.276899:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319734.340659:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319735.301558:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319735.364979:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319736.324287:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319736.388908:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319737.348492:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319737.412892:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319737.540499:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319737.540510:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319737.540513:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319737.540517:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319737.540521:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319737.540532:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4983 00000100:00080000:1.0:1767319737.540542:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319737.540549:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319737.540560:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319737.540598:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1180 x1853163894335488/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319737.540658:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894335488:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319737.540833:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767319737.540845:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894335616:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319737.548877:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319737.548899:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319737.548905:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894335488:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319737.550175:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894335616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319738.372263:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319738.436409:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319739.396233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319739.466506:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319740.420778:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319740.485271:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319741.444423:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319741.510054:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319742.468245:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319742.535423:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319742.660400:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319742.660412:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319742.660415:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319742.660419:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319742.660423:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319742.660434:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4988 00000100:00080000:0.0:1767319742.660443:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319742.660451:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319742.660463:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319742.660500:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8380 x1853163894335744/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319742.660574:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319742.660604:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894335872:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319742.661402:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894335744:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319742.665926:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894335872:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319742.669912:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319742.669930:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319742.669953:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894335744:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319743.494710:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319743.557566:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319744.516232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319744.581405:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319745.541158:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319745.604319:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319746.564262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319746.628456:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319747.588217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319747.652684:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319747.782270:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319747.782281:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319747.782284:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319747.782288:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319747.782292:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319747.782303:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4994 00000100:00080000:2.0:1767319747.782313:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319747.782321:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319747.782332:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319747.782364:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910a680 x1853163894336000/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319747.782437:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894336000:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319747.782444:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894336128:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319747.795457:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319747.795473:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319747.795479:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894336000:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319747.795583:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894336128:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319748.612840:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319748.677520:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319749.637494:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319749.700410:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319750.661120:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319750.724682:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319751.684837:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319751.749228:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319752.711256:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319752.774890:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319752.900316:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319752.900326:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319752.900329:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319752.900333:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1767319752.900334:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319727/real 1767319727] req@ffff9cfe089f9c00 x1853163894334848/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319752 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319752.900337:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319752.900343:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 4999 00000100:00080000:0.0:1767319752.900352:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319752.900359:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767319752.900361:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089f9c00 x1853163894334848/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319752 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:0.0:1767319752.900369:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00080000:3.0:1767319752.900377:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319752.900395:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767319752.900397:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fbb80 x1853163894336256/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319752.900399:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894334848:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767319752.900422:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894336256:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319752.900436:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319752.900439:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319752.900454:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319752.900457:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 4978 00000100:00080000:0.0:1767319752.900460:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319752.900463:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767319752.900473:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8700 x1853163894336512/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319752.900497:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894336384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319752.900516:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894336512:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767319752.902778:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319752.902793:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319752.902798:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894336256:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319752.903196:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894336384:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319753.732210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319753.796576:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319754.756217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319754.821404:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319755.780731:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319755.846767:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319756.804399:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319756.868313:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319757.828232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319757.892795:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319758.021700:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319758.021713:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319758.021716:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319758.021720:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319758.021724:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319758.021734:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5004 00000100:00080000:1.0:1767319758.021744:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319758.021751:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319758.021764:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319758.021804:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1f80 x1853163894336640/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319758.023895:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894336640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319758.025162:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894336768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319758.033313:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894336768:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319758.033449:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319758.033456:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319758.033474:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894336640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319758.852263:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319758.916450:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319759.877643:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319759.940349:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319760.900209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319760.964525:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319761.924246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319761.991861:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319762.948262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319763.014949:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319763.140692:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319763.140703:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319763.140706:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319763.140711:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319763.140715:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319763.140725:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5009 00000100:00080000:0.0:1767319763.140736:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319763.140745:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319763.140757:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319763.140808:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8380 x1853163894336896/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319763.140888:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894337024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319763.141893:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894336896:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319763.144438:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894337024:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319763.144544:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319763.144550:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319763.144554:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894336896:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319763.972221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319764.036413:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319765.000028:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319765.063486:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319766.020205:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319766.084517:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319767.044295:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319767.116824:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319768.068253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319768.150511:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319768.260559:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319768.260569:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319768.260572:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319768.260576:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319768.260580:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319768.260591:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5014 00000100:00080000:0.0:1767319768.260601:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319768.260608:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319768.260620:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319768.260654:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa680 x1853163894337152/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319768.260724:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319768.260736:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894337280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319768.260977:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894337152:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319768.276129:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319768.276148:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319768.276170:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894337152:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319768.277151:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894337280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319769.095982:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319769.156385:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319770.116253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319770.180564:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319771.140221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319771.204370:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319772.164302:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319772.229340:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319773.188239:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319773.252819:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319773.381210:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319773.381222:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319773.381224:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319773.381228:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319773.381232:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319773.381243:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5019 00000100:00080000:3.0:1767319773.381253:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319773.381260:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319773.381272:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319773.381307:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894337408/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319773.381689:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894337536:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319773.382817:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894337408:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767319773.388334:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319773.388351:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319773.388357:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894337408:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319773.388448:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894337536:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319774.212289:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319774.276528:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319775.236697:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319775.304106:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319776.260228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319776.324850:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319777.286464:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319777.348608:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319777.476467:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319752/real 1767319752] req@ffff9cfe089f8700 x1853163894336512/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319777 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319777.476503:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089f8700 x1853163894336512/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319777 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319777.476524:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319777.476554:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767319777.476558:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894336512:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767319777.476643:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319777.476648:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319777.476652:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319777.476658:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5004 00000100:00080000:0.0:1767319777.476668:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319777.476674:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767319777.476707:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089faa00 x1853163894337664/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767319777.476732:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319777.476735:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319777.476737:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319777.476751:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5024 00000100:00080000:0.0:1767319777.476755:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319777.476759:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319777.476769:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319777.476780:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa300 x1853163894337792/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319777.476831:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894337920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319777.476999:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894337664:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767319777.477034:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894337792:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319777.489723:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894337920:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319777.489835:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319777.489843:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319777.489848:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894337792:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319778.308147:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319778.372804:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319779.332405:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319779.401236:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319780.357295:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319780.421831:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319781.380416:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319781.444795:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319782.404262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319782.468580:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319782.599127:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319782.599138:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319782.599141:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319782.599162:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319782.599166:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319782.599176:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5028 00000100:00080000:2.0:1767319782.599186:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319782.599193:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319782.599203:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319782.599236:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894338048/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319782.599390:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894338048:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319782.599749:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894338176:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319782.609136:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319782.609157:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319782.609163:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894338048:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319782.609322:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894338176:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319783.428393:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319783.492516:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319784.452251:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319784.521564:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319785.476240:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319785.542108:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319786.500254:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319786.564604:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319787.526873:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319787.588347:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319787.719913:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319787.719935:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319787.719938:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319787.719942:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319787.719947:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319787.719957:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5033 00000100:00080000:3.0:1767319787.719966:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319787.719973:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319787.719984:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319787.720022:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894338304/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319787.720138:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319787.720155:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894338432:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319787.721266:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894338304:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319787.726797:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894338432:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319787.741697:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319787.741714:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319787.741719:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894338304:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319788.548374:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319788.613397:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319789.572195:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319789.636276:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319790.597936:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319790.660958:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319791.620338:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319791.684369:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319792.646737:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319792.709978:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319792.836949:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319792.836961:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319792.836965:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319792.836969:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319792.836973:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319792.836983:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5039 00000100:00080000:1.0:1767319792.836994:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319792.837002:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319792.837014:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319792.837049:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3100 x1853163894338560/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319792.837186:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894338560:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319792.837472:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894338688:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319792.840324:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319792.840338:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319792.840343:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894338560:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319792.840680:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894338688:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319793.668253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319793.732351:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319794.692212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319794.756526:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319795.716214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319795.780741:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319796.740927:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319796.804891:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319797.764268:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319797.828844:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319797.956755:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319797.956767:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319797.956771:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319797.956776:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319797.956781:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319797.956793:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5044 00000100:00080000:1.0:1767319797.956807:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319797.956843:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319797.956855:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319797.956889:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2d80 x1853163894338816/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319797.957070:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894338944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319797.957523:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894338816:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767319797.965066:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319797.965120:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319797.965126:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894338816:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319797.966274:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894338944:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319798.788199:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319798.856886:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319799.812231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319799.876325:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319800.836227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319800.905929:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319801.860245:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319801.924366:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319802.052309:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319777/real 1767319777] req@ffff9cfe089faa00 x1853163894337664/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319802 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767319802.052344:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089faa00 x1853163894337664/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319802 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767319802.052364:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319802.052457:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767319802.052463:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894337664:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767319802.053763:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319802.053773:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767319802.053777:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319802.053785:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5028 00000100:00080000:0.0:1767319802.053796:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319802.053804:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767319802.053843:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb480 x1853163894339072/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767319802.053878:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319802.053883:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319802.053885:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319802.053888:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5049 00000100:00080000:0.0:1767319802.053913:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319802.053919:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319802.053929:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319802.053943:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894339200/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319802.054041:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319802.054059:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894339328:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319802.054179:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894339072:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767319802.058775:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894339328:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319802.058904:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894339200:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767319802.061863:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319802.061896:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319802.061901:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894339200:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319802.885045:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319802.948293:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319803.913930:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319803.975407:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319804.933403:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319804.998584:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319805.956211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319806.034334:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319806.987701:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319807.045646:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319807.173327:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319807.173339:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319807.173342:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319807.173347:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319807.173351:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319807.173365:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5053 00000100:00080000:1.0:1767319807.173377:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319807.173384:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319807.173410:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319807.173447:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1500 x1853163894339456/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319807.173532:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767319807.173547:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894339584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319807.173975:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894339456:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767319807.176138:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319807.176151:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319807.176157:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894339456:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319807.176608:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894339584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319808.004561:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319808.068578:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319809.028450:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319809.093179:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319810.052204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319810.117044:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319811.076658:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319811.140318:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319812.101385:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319812.164550:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319812.292633:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319812.292651:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319812.292654:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319812.292658:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319812.292663:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319812.292672:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5058 00000100:00080000:1.0:1767319812.292683:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319812.292689:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319812.292699:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319812.292732:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0700 x1853163894339712/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319812.292793:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767319812.292805:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894339840:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319812.293160:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894339712:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767319812.306417:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319812.306445:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319812.306451:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894339712:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319812.306715:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894339840:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319813.124211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319813.190674:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319814.149576:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319814.212796:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319815.172368:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319815.236477:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319816.196217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319816.260466:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319817.220590:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319817.288806:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319817.412986:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319817.412998:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319817.413001:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319817.413005:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319817.413010:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319817.413032:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5063 00000100:00080000:3.0:1767319817.413043:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319817.413050:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319817.413062:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319817.413338:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894339968/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319817.413427:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319817.413442:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894340096:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319817.414832:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894339968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319817.419613:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894340096:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319817.422327:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319817.422356:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319817.422362:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894339968:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319818.244550:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319818.311258:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319819.268302:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319819.332374:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319820.292444:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319820.356951:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319821.316398:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319821.383771:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319822.340502:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319822.404451:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319822.532423:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319822.532437:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319822.532440:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319822.532445:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319822.532450:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319822.532464:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5068 00000100:00080000:3.0:1767319822.532477:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319822.532486:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319822.532502:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319822.532554:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894340224/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319822.532645:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319822.532758:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894340352:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319822.533377:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894340224:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319822.536058:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319822.536135:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319822.536141:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894340224:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319822.536562:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894340352:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319823.364225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319823.428721:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319824.389699:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319824.456748:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319825.412233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319825.477566:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319826.436369:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319826.500594:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319827.460817:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319827.524887:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319827.652477:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319802/real 1767319802] req@ffff9cfe089fb480 x1853163894339072/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319827 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319827.652508:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fb480 x1853163894339072/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319827 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319827.652538:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319827.652601:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767319827.652606:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894339072:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767319827.654494:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319827.654503:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767319827.654506:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319827.654514:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5053 00000100:00080000:2.0:1767319827.654534:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319827.654541:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767319827.654590:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894340480/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767319827.654618:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319827.654622:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319827.654623:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319827.654627:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5073 00000100:00080000:2.0:1767319827.654631:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319827.654636:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319827.654645:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319827.654817:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894340480:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767319827.655058:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894340608/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319827.655134:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894340736:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319827.655461:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894340608:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319827.658335:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894340736:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319827.658466:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319827.658473:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319827.658477:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894340608:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319828.484301:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319828.550043:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319829.508333:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319829.573853:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319830.532603:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319830.597203:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319831.557201:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319831.620340:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319832.580416:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319832.644498:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319832.772248:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319832.772265:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319832.772268:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319832.772274:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319832.772280:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319832.772293:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5079 00000100:00080000:2.0:1767319832.772309:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319832.772317:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319832.772357:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319832.772402:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894340864/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319832.772475:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894340864:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319832.772500:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767319832.772513:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894340992:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319832.786035:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894340992:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319832.788061:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319832.788101:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319832.788107:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894340864:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319833.607597:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319833.668395:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319834.628198:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319834.692482:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319835.652180:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319835.716764:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319836.676445:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319836.740438:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319837.700272:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319837.764525:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319837.892629:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319837.892640:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319837.892643:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319837.892646:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319837.892649:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319837.892659:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5084 00000100:00080000:2.0:1767319837.892669:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319837.892675:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319837.892687:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319837.892727:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894341120/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319837.892847:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894341120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319837.892876:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894341248:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319837.906001:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319837.906023:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319837.906030:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894341120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319837.906369:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894341248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319838.724306:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319838.791593:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319839.748734:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319839.815712:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319840.772475:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319840.836710:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319841.797519:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319841.860444:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319842.823438:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319842.890502:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319843.013107:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319843.013120:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319843.013124:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319843.013128:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319843.013133:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319843.013153:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5089 00000100:00080000:1.0:1767319843.013166:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1767319843.013174:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319843.013209:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319843.013250:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1c00 x1853163894341376/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319843.013323:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894341504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319843.013437:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894341376:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319843.027957:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319843.027979:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319843.027986:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894341376:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319843.032291:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894341504:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319843.844824:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319843.912644:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319844.868769:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319844.933183:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319845.892653:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319845.956404:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319846.916582:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319846.981324:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319847.940257:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319848.004335:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319848.133951:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319848.133964:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319848.133968:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319848.133989:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319848.133994:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319848.134007:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5094 00000100:00080000:2.0:1767319848.134022:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1767319848.134031:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319848.134047:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319848.134115:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894341632/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319848.134215:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894341760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319848.135221:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894341632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319848.138940:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894341760:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319848.141300:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319848.141317:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319848.141324:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894341632:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319848.964795:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319849.028477:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319849.988398:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319850.052337:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319851.016834:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319851.079865:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319852.038603:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319852.100276:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319852.228285:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319827/real 1767319827] req@ffff9cfe29109f80 x1853163894340480/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319852 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319852.228328:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29109f80 x1853163894340480/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319852 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319852.228354:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319852.228486:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767319852.228493:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894340480:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767319852.230279:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319852.230291:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319852.230296:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319852.230307:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5079 00000100:00080000:1.0:1767319852.230321:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319852.230330:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767319852.230381:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0000 x1853163894341888/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767319852.230491:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319852.230496:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319852.230498:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319852.230504:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5099 00000100:00080000:1.0:1767319852.230510:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1767319852.230515:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319852.230526:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319852.230542:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0e00 x1853163894342016/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319852.230603:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894342144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319852.230852:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894341888:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767319852.230892:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894342016:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319852.236754:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319852.236775:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319852.236782:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894342016:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319852.236904:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894342144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319853.060217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319853.124452:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319854.084518:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319854.148619:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319855.109471:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319855.172349:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319856.132210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319856.196380:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319857.156184:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319857.220347:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319857.348463:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319857.348473:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319857.348476:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319857.348479:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319857.348483:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319857.348492:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5103 00000100:00080000:1.0:1767319857.348502:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319857.348509:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319857.348519:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319857.348553:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1880 x1853163894342272/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319857.348626:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894342400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319857.348808:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894342272:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319857.351172:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319857.351193:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319857.351200:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894342272:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319857.352873:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894342400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319858.180418:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319858.245037:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319859.204313:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319859.271365:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319860.228275:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319860.295022:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319861.252903:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319861.316674:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319862.276464:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319862.340327:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319862.469354:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319862.469363:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319862.469366:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319862.469370:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319862.469374:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319862.469386:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5108 00000100:00080000:2.0:1767319862.469398:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319862.469405:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319862.469416:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319862.469447:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894342528/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319862.469506:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894342656:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319862.470172:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894342528:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319862.475169:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894342656:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319862.475466:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319862.475473:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319862.475478:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894342528:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319863.300222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319863.364585:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319864.324277:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319864.388706:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319865.348178:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319865.414636:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319866.372401:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319866.440444:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319867.396266:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319867.460457:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319867.588360:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319867.588391:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319867.588395:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319867.588400:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319867.588416:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319867.588428:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5113 00000100:00080000:2.0:1767319867.588442:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319867.588450:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319867.588463:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319867.588499:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894342784/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319867.588600:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894342912:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319867.589975:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894342784:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319867.595319:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319867.595340:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319867.595346:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894342784:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319867.595720:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894342912:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319868.422220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319868.485642:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319869.444286:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319869.510022:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319870.468249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319870.532382:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319871.499249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319871.556668:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319872.516713:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319872.580705:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319872.709165:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319872.709177:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319872.709180:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319872.709184:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319872.709189:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319872.709200:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5118 00000100:00080000:2.0:1767319872.709212:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319872.709221:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319872.709234:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319872.709289:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894343040/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319872.709352:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767319872.709381:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894343168:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319872.710256:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894343040:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319872.716636:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894343168:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319872.716847:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319872.716853:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319872.716856:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894343040:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319873.540197:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319873.605902:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319874.564262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319874.632192:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319875.588231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319875.653431:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319876.612352:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319876.676496:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319877.636265:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319877.704792:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319877.828235:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319852/real 1767319852] req@ffff9cfe0f3d0000 x1853163894341888/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319877 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319877.828300:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0000 x1853163894341888/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319877 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319877.828321:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319877.828348:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767319877.828352:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894341888:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767319877.828472:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319877.828478:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319877.828482:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319877.828487:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5103 00000100:00080000:1.0:1767319877.828497:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319877.828503:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767319877.828531:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3480 x1853163894343296/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767319877.828565:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319877.828569:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319877.828571:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319877.828575:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5124 00000100:00080000:1.0:1767319877.828580:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319877.828584:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319877.828603:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319877.828619:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0000 x1853163894343424/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319877.828671:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894343552:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319877.829352:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894343296:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767319877.829404:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894343424:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319877.832329:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894343552:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319877.837791:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319877.837809:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319877.837815:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894343424:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319878.660235:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319878.725441:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319879.684294:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319879.751790:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319880.708261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319880.772607:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319881.735596:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319881.799395:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319882.757717:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319882.820413:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319882.948418:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319882.948429:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319882.948432:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319882.948436:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319882.948441:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319882.948452:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5129 00000100:00080000:3.0:1767319882.948462:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319882.948470:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319882.948481:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319882.948519:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894343680/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319882.948603:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319882.948619:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894343808:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319882.949159:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894343680:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319882.954139:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319882.954158:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319882.954164:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894343680:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319882.958828:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894343808:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319883.780396:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319883.847850:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319884.804441:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319884.868534:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319885.828232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319885.892339:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319886.852466:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319886.921875:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319887.879507:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319887.940821:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319888.072984:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319888.072994:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319888.072997:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319888.073000:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319888.073005:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319888.073017:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5134 00000100:00080000:2.0:1767319888.073029:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319888.073036:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319888.073048:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319888.073105:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894343936/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319888.073179:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894344064:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319888.074237:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894343936:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319888.103711:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319888.103729:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319888.103769:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894343936:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319888.104709:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894344064:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319888.900299:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319888.968606:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319889.924212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319889.989879:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319890.948890:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319891.012262:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319891.972833:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319892.038429:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319892.997237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319893.063057:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319893.191915:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319893.191929:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319893.191932:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319893.191960:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319893.191965:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319893.191978:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5139 00000100:00080000:2.0:1767319893.191993:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319893.192000:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319893.192051:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319893.193012:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894344192/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319893.193188:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894344192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319893.196781:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894344320:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319893.200604:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319893.200620:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319893.200626:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894344192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319893.203986:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894344320:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319894.020270:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319894.085045:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319895.046817:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319895.112680:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319896.068247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319896.132357:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319897.092211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319897.156665:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319898.116220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319898.180580:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319898.308768:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319898.308778:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319898.308780:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319898.308784:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319898.308788:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319898.308799:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5144 00000100:00080000:2.0:1767319898.308808:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319898.308860:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319898.308871:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319898.308907:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894344448/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319898.309058:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894344448:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319898.309818:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894344576:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319898.322649:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319898.322667:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319898.322674:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894344448:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319898.323017:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894344576:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319899.140420:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319899.204268:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319900.164265:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319900.228538:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319901.189633:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319901.252807:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319902.212238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319902.276353:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319902.405504:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319877/real 1767319877] req@ffff9cfe0f3d3480 x1853163894343296/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319902 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767319902.405887:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d3480 x1853163894343296/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319902 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767319902.405908:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319902.405937:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767319902.405940:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894343296:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767319902.406005:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319902.406010:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319902.406012:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319902.406017:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5129 00000100:00080000:1.0:1767319902.406025:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319902.406031:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767319902.406069:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1880 x1853163894344704/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767319902.406114:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319902.406118:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319902.406119:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319902.406144:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5149 00000100:00080000:1.0:1767319902.406148:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319902.406161:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319902.406172:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319902.406184:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0e00 x1853163894344832/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319902.406308:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767319902.406320:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894344960:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319902.407037:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894344704:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767319902.407113:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894344832:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319902.418226:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894344960:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319902.426486:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319902.426691:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319902.426697:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894344832:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319903.237276:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319903.300898:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319904.260208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319904.327806:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319905.288967:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319905.349217:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319906.308210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319906.372419:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319907.332209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319907.396370:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319907.528249:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319907.528288:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319907.528291:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319907.528294:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319907.528298:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319907.528307:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5153 00000100:00080000:0.0:1767319907.528318:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319907.528326:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319907.528338:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319907.528371:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb480 x1853163894345088/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319907.528473:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319907.528490:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894345216:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319907.529588:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894345088:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767319907.538959:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319907.538975:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319907.538996:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894345088:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319907.539411:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894345216:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319908.356276:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319908.421325:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319909.380382:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319909.444355:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319910.404846:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319910.468584:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319911.428220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319911.492388:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319912.452385:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319912.516314:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319912.645455:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319912.645464:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319912.645467:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319912.645470:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319912.645474:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319912.645485:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5158 00000100:00080000:0.0:1767319912.645494:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319912.645525:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319912.645536:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319912.645573:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9f80 x1853163894345344/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319912.645883:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894345472:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319912.647049:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894345344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319912.652583:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894345472:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319912.653207:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319912.653215:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319912.653219:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894345344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319913.477400:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319913.540511:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319914.500176:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319914.564339:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319915.524186:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319915.588416:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319916.548211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319916.612795:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319917.572217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319917.636319:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319917.765864:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319917.765876:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319917.765879:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319917.765883:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319917.765887:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319917.765897:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5164 00000100:00080000:1.0:1767319917.765906:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319917.765913:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319917.765925:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319917.765960:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1c00 x1853163894345600/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319917.766018:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894345600:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319917.766383:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319917.766394:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894345728:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767319917.769745:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767319917.769758:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767319917.769762:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894345600:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319917.769814:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894345728:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319918.597518:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319918.661205:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319919.620246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319919.684884:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319920.644662:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319920.708276:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319921.668208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319921.732257:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319922.692220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319922.756409:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319922.884283:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319922.884293:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319922.884296:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319922.884300:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319922.884304:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319922.884316:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5169 00000100:00080000:2.0:1767319922.884326:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319922.884333:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319922.884344:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319922.884392:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894345856/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319922.884454:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894345856:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319922.884499:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894345984:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319922.896950:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319922.896966:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319922.896972:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894345856:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319922.897027:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894345984:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319923.718828:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319923.782529:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319924.742392:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319924.804687:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319925.764261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319925.829530:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319926.792493:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319926.852319:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319927.815851:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319927.883359:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767319928.004214:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319902/real 1767319902] req@ffff9cfe0f3d1880 x1853163894344704/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319927 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767319928.004422:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d1880 x1853163894344704/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319927 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767319928.004441:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319928.004471:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767319928.004474:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894344704:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767319928.004599:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319928.004612:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319928.004615:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319928.004619:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5153 00000100:00080000:3.0:1767319928.004627:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319928.004633:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767319928.004714:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894346112/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319928.004739:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319928.004742:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319928.004744:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319928.004748:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5174 00000100:00080000:3.0:1767319928.004751:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319928.004755:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319928.004763:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319928.004775:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894346240/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319928.004833:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319928.004844:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894346368:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319928.005148:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894346112:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767319928.005194:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894346240:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319928.007904:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894346368:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319928.008431:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319928.008438:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319928.008443:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894346240:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319928.836330:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319928.901351:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319929.860153:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319929.924284:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319930.884221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319930.949557:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319931.909262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319931.972680:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319932.934559:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319932.997757:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319933.124898:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319933.124908:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319933.124911:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319933.124915:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319933.124919:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319933.124930:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5179 00000100:00080000:3.0:1767319933.124941:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319933.124948:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319933.124959:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319933.124995:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894346496/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319933.125121:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894346624:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319933.125569:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894346496:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319933.136117:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894346624:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319933.136840:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319933.136849:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319933.136853:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894346496:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319933.958339:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319934.020799:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319934.981505:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319935.044643:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319936.004841:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319936.071219:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319937.030590:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319937.096222:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319938.052949:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319938.128388:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319938.245720:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319938.245733:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319938.245736:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319938.245740:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319938.245745:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319938.245756:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5184 00000100:00080000:2.0:1767319938.245766:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319938.245794:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319938.245805:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319938.245836:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894346752/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319938.245998:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894346752:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319938.246592:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894346880:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319938.253737:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319938.253752:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319938.253758:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894346752:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319938.256775:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894346880:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319939.076187:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319939.140524:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319940.103351:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319940.165360:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319941.126857:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319941.189555:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319942.150627:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319942.212636:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319943.172295:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319943.236552:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319943.365550:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319943.365567:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319943.365571:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319943.365575:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319943.365581:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319943.365597:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5189 00000100:00080000:0.0:1767319943.365613:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319943.365623:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319943.365649:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319943.365696:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8a80 x1853163894347008/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319943.365786:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894347136:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767319943.367154:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894347008:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319943.370291:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894347136:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767319943.376070:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767319943.376123:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767319943.376129:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894347008:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319944.196253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319944.260397:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319945.220473:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319945.284532:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319946.244303:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319946.308350:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319947.268262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319947.334367:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319948.292963:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319948.356967:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319948.485371:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319948.485384:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319948.485388:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319948.485393:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319948.485406:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319948.485420:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5194 00000100:00080000:2.0:1767319948.485437:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319948.485446:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319948.485464:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319948.485515:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894347264/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319948.485621:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894347392:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319948.486117:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894347264:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319948.492199:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319948.492219:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319948.492225:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894347264:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319948.499709:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894347392:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319949.316218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319949.385239:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319950.341118:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319950.405617:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319951.365050:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319951.428659:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319952.394347:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319952.452412:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319953.413274:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319953.476752:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319953.604407:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319953.604447:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319953.604450:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319953.604455:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319953.604460:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319953.604474:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5199 00000100:00080000:1.0:1767319953.604488:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319953.604496:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319953.604511:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319953.604555:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1880 x1853163894347520/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319953.604658:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894347648:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319953.608389:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319928/real 1767319928] req@ffff9cfe18fd5f80 x1853163894346112/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319953 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319953.608431:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd5f80 x1853163894346112/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319953 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319953.608458:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894347520:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319953.608563:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319953.608579:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767319953.608583:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894346112:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767319953.608994:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319953.609005:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767319953.609009:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319953.609019:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5179 00000100:00080000:1.0:1767319953.609029:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319953.609038:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767319953.609108:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2d80 x1853163894347776/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319953.609288:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894347776:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767319953.616328:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894347648:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319953.620270:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319953.620303:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319953.620310:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894347520:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319954.436227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319954.502396:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319955.460897:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319955.525306:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319956.484530:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319956.548743:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319957.509224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319957.575419:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319958.533817:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319958.596396:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319958.724281:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319958.724293:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319958.724297:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319958.724325:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319958.724329:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319958.724340:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5204 00000100:00080000:1.0:1767319958.724353:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319958.724362:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319958.724376:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319958.724412:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2680 x1853163894347904/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319958.724522:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894348032:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319958.725426:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894347904:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319958.730919:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894348032:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319958.731021:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319958.731027:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319958.731030:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894347904:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319959.556564:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319959.620324:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319960.580480:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319960.644425:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767319961.604558:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319961.668531:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319962.628369:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319962.693594:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319963.653258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319963.719020:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319963.844357:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319963.844371:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319963.844375:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319963.844380:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319963.844385:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319963.844399:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5210 00000100:00080000:3.0:1767319963.844416:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319963.844425:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319963.844443:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319963.844492:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894348160/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319963.844585:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894348160:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319963.844613:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894348288:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319963.856978:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894348288:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767319963.861205:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319963.861229:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319963.861245:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894348160:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319964.676399:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319964.740598:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319965.700302:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319965.764433:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319966.724456:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319966.788694:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319967.753439:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319967.812600:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319968.772543:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319968.837659:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767319968.964597:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319968.964612:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767319968.964616:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767319968.964620:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767319968.964626:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767319968.964640:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5215 00000100:00080000:0.0:1767319968.964652:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767319968.964662:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767319968.964680:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767319968.964738:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb800 x1853163894348416/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767319968.964859:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767319968.964875:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894348544:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767319968.965139:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894348416:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767319968.970983:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767319968.971013:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767319968.971020:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894348416:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767319968.971689:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894348544:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319969.796258:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319969.860561:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319970.820280:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319970.884586:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319971.847956:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319971.909622:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319972.868236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319972.933741:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319973.892808:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319973.956392:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319974.084419:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319974.084437:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319974.084441:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319974.084445:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319974.084451:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319974.084465:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5220 00000100:00080000:3.0:1767319974.084487:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319974.084496:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319974.084519:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319974.084570:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894348672/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319974.084677:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319974.084697:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894348800:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319974.084911:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894348672:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319974.093608:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319974.093625:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319974.093630:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894348672:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319974.093825:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894348800:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319974.916218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319974.980449:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319975.941311:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319976.004465:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319976.965713:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319977.032199:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319977.988219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319978.055973:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767319978.183285:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319953/real 1767319953] req@ffff9cfe0f3d2d80 x1853163894347776/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319978 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767319978.183320:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d2d80 x1853163894347776/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767319978 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767319978.183339:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319978.183367:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767319978.183371:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894347776:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767319978.183538:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319978.183544:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767319978.183547:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319978.183552:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5204 00000100:00080000:3.0:1767319978.183563:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319978.183569:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767319978.183603:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894348928/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767319978.183630:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319978.183634:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319978.183636:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319978.183640:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5225 00000100:00080000:3.0:1767319978.183643:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319978.183647:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319978.183657:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319978.183668:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894349056/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319978.183742:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767319978.183756:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894349184:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319978.184715:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894348928:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767319978.184785:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894349056:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319978.190277:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894349184:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319978.193442:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319978.193459:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319978.193464:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894349056:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319979.014238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319979.077818:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319980.036368:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319980.108024:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319981.060220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319981.124413:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319982.084201:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319982.148442:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319983.108256:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319983.174921:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767319983.301617:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319983.301626:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767319983.301630:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767319983.301633:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767319983.301638:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767319983.301647:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5229 00000100:00080000:3.0:1767319983.301656:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767319983.301662:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767319983.301673:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767319983.301705:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894349312/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767319983.301770:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767319983.301784:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894349440:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319983.302195:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894349312:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319983.305980:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319983.305996:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319983.306002:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894349312:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767319983.306129:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894349440:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319984.132293:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319984.200418:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319985.156209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319985.220409:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319986.180205:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319986.244295:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319987.204204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319987.270324:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319988.228205:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319988.292559:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319988.421380:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319988.421391:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319988.421394:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319988.421397:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319988.421401:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319988.421412:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5234 00000100:00080000:1.0:1767319988.421423:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319988.421429:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319988.421440:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319988.421475:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1f80 x1853163894349568/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319988.421545:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767319988.421561:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894349696:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319988.422120:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894349568:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319988.428270:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319988.428295:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319988.428301:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894349568:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319988.429338:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894349696:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319989.253204:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319989.324627:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319990.276243:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319990.340395:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319991.300192:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319991.368764:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319992.324370:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319992.389470:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319993.351448:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319993.412528:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767319993.543013:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319993.543029:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767319993.543032:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767319993.543038:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767319993.543044:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767319993.543058:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5239 00000100:00080000:2.0:1767319993.543074:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767319993.543121:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767319993.543137:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767319993.543185:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894349824/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767319993.543319:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894349952:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319993.543816:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894349824:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319993.547990:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894349952:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767319993.557694:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319993.557718:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319993.557724:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894349824:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767319994.372221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319994.437970:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319995.396562:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319995.460460:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319996.420292:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319996.484310:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319997.444272:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767319997.511959:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767319998.469964:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767319998.532365:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767319998.662241:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319998.662256:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767319998.662259:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767319998.662263:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767319998.662268:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767319998.662281:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5244 00000100:00080000:1.0:1767319998.662294:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767319998.662303:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767319998.662317:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767319998.662365:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0a80 x1853163894350080/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767319998.662455:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894350208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767319998.662884:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894350080:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767319998.673686:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767319998.673708:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767319998.673715:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894350080:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767319998.673814:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894350208:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767319999.492265:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767319999.557872:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320000.516248:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320000.580426:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320001.541178:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320001.606035:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320002.564273:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320002.628610:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320003.588252:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320003.653273:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767320003.780593:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319978/real 1767319978] req@ffff9cfe18fd5c00 x1853163894348928/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320003 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320003.780641:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd5c00 x1853163894348928/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320003 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320003.780668:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320003.780711:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767320003.780716:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894348928:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767320003.780829:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320003.780835:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320003.780839:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320003.780844:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5229 00000100:00080000:2.0:1767320003.780856:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320003.780864:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767320003.780919:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910a680 x1853163894350336/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767320003.780947:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320003.780951:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320003.780953:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320003.780958:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5250 00000100:00080000:2.0:1767320003.780963:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320003.780967:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320003.780987:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320003.781001:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894350464/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320003.781158:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894350592:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320003.781869:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894350336:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767320003.781933:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894350464:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320003.792912:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894350592:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320003.798298:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320003.798318:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320003.798323:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894350464:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320004.612795:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320004.678369:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320005.646631:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320005.700373:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320006.660645:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320006.726174:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320007.684794:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320007.749075:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320008.708351:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320008.772365:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320008.900726:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320008.900738:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320008.900740:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320008.900744:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320008.900749:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320008.900759:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5255 00000100:00080000:1.0:1767320008.900769:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320008.900776:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320008.900805:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320008.900834:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1180 x1853163894350720/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320008.900902:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894350848:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320008.901565:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894350720:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767320008.913195:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320008.913272:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320008.913278:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894350720:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320008.913446:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894350848:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320009.732201:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320009.796495:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320010.756263:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320010.823304:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320011.781147:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320011.844659:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320012.804558:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320012.870378:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320013.830504:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320013.892529:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320014.025701:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320014.025712:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320014.025716:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320014.025720:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320014.025724:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320014.025734:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5260 00000100:00080000:3.0:1767320014.025745:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320014.025752:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320014.025763:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320014.025801:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894350976/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320014.025908:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894350976:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320014.026842:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894351104:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320014.036276:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894351104:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320014.036735:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320014.036743:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320014.036747:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894350976:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320014.853346:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320014.916325:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320015.876938:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320015.940471:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320016.902287:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320016.964350:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320017.924216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320017.988604:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320018.949961:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320019.013436:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320019.141483:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320019.141492:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320019.141495:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320019.141499:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320019.141503:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320019.141513:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5265 00000100:00080000:3.0:1767320019.141525:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320019.141532:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320019.141572:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320019.141608:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894351232/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320019.141679:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320019.141696:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894351360:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320019.141881:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894351232:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767320019.147696:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320019.147713:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320019.147718:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894351232:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320019.154403:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894351360:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320019.972882:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320020.039559:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320020.996182:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320021.060561:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320022.020251:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320022.085023:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320023.044220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320023.109668:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320024.070432:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320024.132468:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320024.260528:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320024.260538:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320024.260541:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320024.260544:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320024.260550:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320024.260562:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5270 00000100:00080000:1.0:1767320024.260574:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320024.260582:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320024.260595:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320024.260635:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3800 x1853163894351488/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320024.260707:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894351616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320024.260866:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894351488:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767320024.264289:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320024.264312:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320024.264318:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894351488:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320024.264360:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894351616:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320025.093071:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320025.157731:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320026.116750:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320026.181967:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320027.140203:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320027.204459:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320028.166941:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320028.228426:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767320028.356829:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320003/real 1767320003] req@ffff9cfe2910a680 x1853163894350336/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320028 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320028.356866:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe2910a680 x1853163894350336/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320028 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320028.356887:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320028.356918:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767320028.356923:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894350336:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767320028.357021:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320028.357046:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767320028.357050:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320028.357055:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5255 00000100:00080000:3.0:1767320028.357065:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320028.357072:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767320028.357127:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6d80 x1853163894351744/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767320028.357151:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320028.357155:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320028.357157:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320028.357161:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5275 00000100:00080000:3.0:1767320028.357165:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320028.357169:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320028.357178:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320028.357192:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894351872/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320028.357371:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894351744:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767320028.357474:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894351872:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320028.357507:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894352000:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320028.363115:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894352000:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320028.364140:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320028.364152:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320028.364157:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894351872:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320029.188215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320029.252408:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320030.212205:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320030.276825:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320031.236224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320031.300684:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320032.260433:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320032.324430:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320033.284524:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320033.348755:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320033.480627:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320033.480638:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320033.480641:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320033.480663:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320033.480667:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320033.480677:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5279 00000100:00080000:3.0:1767320033.480688:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320033.480695:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320033.480706:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320033.480740:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894352128/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320033.480888:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894352128:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320033.481963:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894352256:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320033.492032:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320033.492047:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320033.492051:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894352128:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320033.492334:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894352256:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320034.308167:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320034.372273:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320035.332227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320035.396287:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320036.356329:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320036.421241:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320037.384976:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320037.446646:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320038.404245:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320038.468456:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320038.596411:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320038.596422:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320038.596425:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320038.596429:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320038.596433:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320038.596444:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5284 00000100:00080000:3.0:1767320038.596455:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320038.596463:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320038.596475:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320038.596514:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894352384/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320038.596617:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320038.596631:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894352512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320038.597110:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894352384:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767320038.604292:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320038.604308:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320038.604330:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894352384:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320038.604567:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894352512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320039.428301:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320039.493627:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320040.452378:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320040.517543:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320041.476469:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320041.540410:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320042.500219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320042.564456:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320043.525594:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320043.595069:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320043.716638:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320043.716648:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320043.716651:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320043.716655:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320043.716659:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320043.716671:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5289 00000100:00080000:0.0:1767320043.716682:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320043.716689:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320043.716701:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320043.716735:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9880 x1853163894352640/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320043.716900:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894352768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320043.717019:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894352640:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767320043.726523:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320043.726540:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320043.726545:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894352640:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320043.727769:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894352768:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320044.548596:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320044.612344:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320045.575326:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320045.638331:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320046.596167:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320046.660414:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320047.620254:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320047.684331:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320048.644579:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320048.709367:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320048.836234:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320048.836245:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320048.836248:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320048.836253:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320048.836257:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320048.836277:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5295 00000100:00080000:3.0:1767320048.836287:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320048.836295:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320048.836307:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320048.836344:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4380 x1853163894352896/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320048.836426:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320048.836455:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894353024:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320048.836779:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894352896:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320048.839167:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894353024:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320048.839289:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320048.839296:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320048.839300:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894352896:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320049.668216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320049.735002:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320050.692297:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320050.756311:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320051.716576:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320051.780323:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320052.740242:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320052.804290:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320053.764850:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320053.831705:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320053.956315:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320053.956327:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320053.956330:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320053.956334:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320053.956340:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320053.956351:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5300 00000100:00080000:1.0:1767320053.956364:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320053.956372:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320053.956385:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320053.956425:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2300 x1853163894353152/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320053.956496:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894353280:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320053.956675:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320028/real 1767320028] req@ffff9cfe18fd6d80 x1853163894351744/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320053 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320053.956698:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd6d80 x1853163894351744/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320053 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320053.956712:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894353152:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767320053.956745:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320053.956764:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767320053.956769:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894351744:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767320053.956974:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320053.956979:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767320053.956981:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320053.956984:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5279 00000100:00080000:1.0:1767320053.956988:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320053.957006:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767320053.957020:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3b80 x1853163894353408/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320053.957196:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894353408:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767320053.964168:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894353280:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320053.965279:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320053.965295:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320053.965311:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894353152:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320054.788233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320054.852499:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320055.812954:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320055.876499:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320056.836350:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320056.901344:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320057.860301:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320057.926555:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320058.884292:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320058.948342:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320059.077777:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320059.077788:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320059.077791:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320059.077795:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320059.077801:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320059.077812:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5305 00000100:00080000:2.0:1767320059.077825:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320059.077832:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320059.077847:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320059.077888:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894353536/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320059.077967:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320059.077983:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894353664:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320059.078550:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894353536:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767320059.083049:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320059.083065:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320059.083071:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894353536:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320059.084037:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894353664:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320059.908206:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320059.972377:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320060.934021:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320060.996312:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320061.956222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320062.020507:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320062.980306:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320063.044396:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320064.006374:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320064.068693:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320064.197699:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320064.197715:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320064.197718:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320064.197723:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320064.197729:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320064.197742:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5310 00000100:00080000:1.0:1767320064.197756:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320064.197764:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320064.197780:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320064.197829:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2a00 x1853163894353792/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320064.197916:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767320064.197934:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894353920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320064.198654:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894353792:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767320064.218691:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320064.218711:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767320064.218717:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894353792:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320064.218871:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894353920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320065.029731:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320065.095173:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320066.053538:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320066.118219:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320067.076253:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320067.145965:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320068.100441:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320068.165402:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320069.125240:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320069.190067:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320069.316373:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320069.316388:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320069.316392:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320069.316396:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320069.316426:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320069.316440:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5315 00000100:00080000:1.0:1767320069.316453:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320069.316461:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320069.316475:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320069.316518:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0380 x1853163894354048/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320069.316647:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767320069.316672:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894354176:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320069.318152:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894354048:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767320069.329893:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320069.329915:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767320069.329920:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894354048:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320069.331546:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894354176:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320070.148246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320070.212594:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320071.172261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320071.236958:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320072.196642:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320072.260542:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320073.220247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320073.284346:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320074.247390:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320074.312349:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320074.436904:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320074.436919:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320074.436923:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320074.436928:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320074.436933:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320074.436947:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5320 00000100:00080000:3.0:1767320074.436960:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320074.436969:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320074.436984:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320074.437075:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894354304/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320074.437185:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320074.437203:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894354432:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320074.437632:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894354304:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320074.443484:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894354432:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320074.449155:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320074.449503:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320074.449511:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894354304:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320075.268603:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320075.332410:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320076.292240:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320076.358795:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320077.316213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320077.381338:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320078.346988:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320078.404626:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320078.533387:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320053/real 1767320053] req@ffff9cfe0f3d3b80 x1853163894353408/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320078 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767320078.533433:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d3b80 x1853163894353408/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320078 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767320078.533469:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320078.536052:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320078.536064:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320078.536070:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320078.536098:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5305 00000100:00080000:0.0:1767320078.536114:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320078.536122:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767320078.536176:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9880 x1853163894354560/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320078.536197:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320078.536201:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320078.536204:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320078.536232:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5325 00000100:00080000:0.0:1767320078.536237:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320078.536241:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320078.536252:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320078.536265:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb100 x1853163894354688/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320078.536335:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894354816:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767320078.536692:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767320078.536705:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894353408:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767320078.536732:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894354560:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767320078.536769:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894354688:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767320078.540069:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320078.540126:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767320078.540133:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894354688:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320078.540242:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894354816:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320079.364360:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320079.429170:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320080.388262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320080.453073:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320081.412591:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320081.476530:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320082.436554:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320082.500438:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320083.460930:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320083.528357:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320083.652353:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320083.652363:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320083.652366:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320083.652370:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320083.652374:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320083.652385:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5329 00000100:00080000:3.0:1767320083.652395:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320083.652402:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320083.652413:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320083.652459:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894354944/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320083.652563:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894354944:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320083.652673:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894355072:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320083.656005:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320083.656022:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320083.656027:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894354944:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320083.658810:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894355072:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320084.484250:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320084.548255:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320085.508235:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320085.572458:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320086.532223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320086.598201:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320087.557851:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320087.621397:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320088.580419:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320088.644474:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320088.772565:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320088.772575:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320088.772579:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320088.773151:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320088.773180:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320088.773189:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5335 00000100:00080000:2.0:1767320088.773197:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320088.773203:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320088.773212:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320088.773241:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894355200/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320088.773305:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894355328:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320088.773326:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894355200:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320088.777468:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894355328:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320088.777971:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320088.777979:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320088.777984:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894355200:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320089.604406:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320089.668288:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320090.628265:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320090.692377:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320091.652169:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320091.716293:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320092.676246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320092.740294:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320093.700535:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320093.764389:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320093.892210:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320093.892219:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320093.892222:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320093.892226:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320093.892231:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320093.892243:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5340 00000100:00080000:2.0:1767320093.892253:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320093.892259:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320093.892271:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320093.892333:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894355456/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320093.892405:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894355584:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320093.892457:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894355456:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320093.895816:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894355584:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320093.895952:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320093.895959:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320093.895962:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894355456:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320094.724228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320094.789040:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320095.748880:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320095.812555:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320096.772271:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320096.836317:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320097.801071:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320097.860418:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320098.820221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320098.885135:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320099.014151:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320099.014160:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320099.014163:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320099.014167:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320099.014172:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320099.014182:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5345 00000100:00080000:2.0:1767320099.014193:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320099.014200:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320099.014210:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320099.014239:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109180 x1853163894355712/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320099.014552:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894355840:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320099.015740:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894355712:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320099.022839:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894355840:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320099.031733:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320099.031748:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320099.031753:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894355712:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320099.844939:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320099.911429:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320100.868262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320100.932266:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320101.892243:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320101.956931:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320102.918418:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320102.983031:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767320103.109369:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320078/real 1767320078] req@ffff9cfe089f9880 x1853163894354560/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320103 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320103.109403:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089f9880 x1853163894354560/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320103 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320103.109422:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320103.109622:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320103.109628:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767320103.109631:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320103.109637:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5329 00000100:00080000:3.0:1767320103.109646:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320103.109665:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767320103.109699:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6680 x1853163894355968/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767320103.109715:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320103.109718:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320103.109720:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320103.109724:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5350 00000100:00080000:3.0:1767320103.109727:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320103.109731:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320103.109740:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320103.109750:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6d80 x1853163894356096/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320103.109870:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894356224:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320103.110156:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767320103.110164:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894354560:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767320103.110187:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894355968:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767320103.110221:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894356096:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320103.117031:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894356224:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320103.118851:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320103.118863:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320103.118869:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894356096:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320103.940624:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320104.004395:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320104.965396:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320105.032616:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320105.989518:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320106.052772:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320107.013468:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320107.077424:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320108.036257:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320108.102506:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320108.228657:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320108.228667:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320108.228670:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320108.228674:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320108.228679:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320108.228689:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5354 00000100:00080000:2.0:1767320108.228698:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320108.228704:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320108.228715:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320108.228778:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894356352/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320108.228845:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320108.228859:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894356480:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320108.229153:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894356352:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767320108.254860:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320108.254877:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320108.254883:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894356352:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320108.255063:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894356480:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320109.062681:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320109.124812:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320110.087309:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320110.148714:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320111.113292:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320111.173322:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320112.132298:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320112.196946:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320113.156261:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320113.222260:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320113.348233:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320113.348246:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320113.348249:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320113.348253:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320113.348258:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320113.348269:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5359 00000100:00080000:2.0:1767320113.348281:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320113.348291:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320113.348303:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320113.348345:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894356608/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320113.348449:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894356736:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320113.348829:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894356608:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320113.354631:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894356736:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767320113.366210:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320113.366229:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320113.366235:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894356608:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320114.180216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320114.244410:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320115.204964:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320115.270117:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320116.229695:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320116.293105:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320117.256773:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320117.316425:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320118.276762:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320118.341147:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320118.468399:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320118.468409:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320118.468412:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320118.468416:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320118.468437:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320118.468447:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5364 00000100:00080000:0.0:1767320118.468457:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320118.468464:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320118.468476:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320118.468506:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9880 x1853163894356864/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320118.468589:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767320118.468606:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894356992:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320118.469399:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894356864:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767320118.486159:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320118.486176:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320118.486182:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894356864:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320118.487964:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894356992:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320119.300768:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320119.365955:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320120.325213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320120.388329:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320121.348275:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320121.416077:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320122.372285:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320122.438108:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320123.397861:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320123.461259:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320123.588457:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320123.588472:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320123.588476:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320123.588481:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320123.588487:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320123.588502:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5369 00000100:00080000:0.0:1767320123.588516:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320123.588525:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320123.588540:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320123.588601:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8e00 x1853163894357120/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320123.588798:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894357248:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320123.590343:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894357120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320123.593980:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894357248:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767320123.595605:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320123.595625:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320123.595630:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894357120:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320124.421441:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320124.484277:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320125.444227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320125.508526:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320126.468200:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320126.533056:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320127.492187:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320127.558363:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320128.516246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320128.580371:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320128.708292:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320103/real 1767320103] req@ffff9cfe18fd6680 x1853163894355968/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320128 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767320128.708338:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd6680 x1853163894355968/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320128 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767320128.708367:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320128.708383:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767320128.708415:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894355968:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767320128.708453:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320128.708466:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320128.708471:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320128.708481:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5354 00000100:00080000:0.0:1767320128.708503:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320128.708512:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767320128.708571:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8e00 x1853163894357376/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320128.708604:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320128.708608:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320128.708610:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320128.708615:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5374 00000100:00080000:0.0:1767320128.708618:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320128.708622:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320128.708631:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320128.708644:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9500 x1853163894357504/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320128.708750:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894357376:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767320128.708870:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894357504:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320128.709052:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894357632:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320128.715197:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894357632:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767320128.715872:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320128.715890:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320128.715897:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894357504:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320129.540588:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320129.606441:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320130.564661:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320130.628291:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320131.590028:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320131.652269:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320132.612329:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320132.679057:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320133.636536:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320133.700418:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320133.828604:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320133.828618:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320133.828621:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320133.828625:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320133.828631:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320133.828644:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5380 00000100:00080000:2.0:1767320133.828656:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320133.828664:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320133.832609:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320133.832703:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910a680 x1853163894357760/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320133.832799:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894357888:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320133.834550:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894357760:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320133.842820:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894357888:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767320133.849689:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320133.849706:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320133.849712:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894357760:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320134.660281:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320134.724740:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320135.684173:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320135.748562:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320136.708249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320136.772831:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320137.732278:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320137.796399:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320138.756252:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320138.825026:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320138.948360:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320138.948370:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320138.948373:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320138.948377:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320138.948382:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320138.948392:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5385 00000100:00080000:0.0:1767320138.948403:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320138.948411:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320138.948421:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320138.948466:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb100 x1853163894358016/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320138.953900:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767320138.953944:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894358144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320138.955136:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894358016:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320138.962511:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894358144:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767320138.968168:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320138.968183:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320138.968188:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894358016:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320139.785868:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320139.844461:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320140.804349:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320140.868414:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320141.828724:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320141.892543:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320142.852214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320142.916624:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320143.876392:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320143.940570:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320144.068624:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320144.068634:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320144.068638:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320144.068641:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320144.068646:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320144.068657:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5390 00000100:00080000:3.0:1767320144.068667:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320144.068675:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320144.068686:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320144.068724:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6680 x1853163894358272/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320144.068807:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894358400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320144.075411:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894358400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320144.078258:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894358272:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767320144.092076:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320144.092312:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320144.092318:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894358272:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320144.900214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320144.967816:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320145.924628:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320145.995627:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320146.948209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320147.015466:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320147.972210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320148.037875:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320148.996221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320149.060434:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320149.188465:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320149.188472:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320149.188475:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320149.188478:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320149.188482:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320149.188504:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5395 00000100:00080000:3.0:1767320149.188514:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320149.188520:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320149.188530:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320149.188571:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894358528/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320149.188632:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894358656:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320149.189322:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894358528:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767320149.193728:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320149.193743:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320149.193759:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894358528:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320149.194056:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894358656:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320150.020206:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320150.087157:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320151.047284:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320151.108382:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320152.069518:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320152.132504:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320153.095099:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320153.158097:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767320153.284210:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320128/real 1767320128] req@ffff9cfe089f8e00 x1853163894357376/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320153 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320153.284246:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089f8e00 x1853163894357376/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320153 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320153.284277:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320153.284381:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767320153.284387:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894357376:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767320153.285753:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320153.285778:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320153.285781:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320153.285791:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5380 00000100:00080000:2.0:1767320153.285800:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320153.285807:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767320153.285841:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894358784/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1767320153.285871:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320153.285875:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320153.285877:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320153.285889:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5400 00000100:00080000:2.0:1767320153.285893:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320153.285897:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320153.285906:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320153.285918:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894358912/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320153.285975:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320153.285992:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894359040:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320153.286278:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894358784:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767320153.286328:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894358912:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767320153.291371:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320153.291387:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320153.291393:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894358912:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320153.291662:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894359040:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320154.116217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320154.180510:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320155.141396:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320155.209436:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320156.164214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320156.230127:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320157.190569:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320157.252364:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320158.212234:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320158.276670:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320158.404215:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320158.404236:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320158.404239:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320158.404259:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320158.404264:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320158.404281:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5404 00000100:00080000:0.0:1767320158.404291:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320158.404297:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320158.404307:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320158.404339:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8e00 x1853163894359168/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320158.404486:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894359168:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320158.404695:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894359296:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320158.411187:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894359296:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320158.411984:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320158.411993:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320158.411997:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894359168:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320159.236288:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320159.300526:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320160.260206:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320160.324356:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320161.285355:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320161.348333:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320162.308869:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320162.373492:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320163.335710:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320163.397698:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320163.525660:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320163.525668:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320163.525671:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320163.525688:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320163.525692:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320163.525704:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5409 00000100:00080000:2.0:1767320163.525713:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320163.525721:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320163.525733:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320163.525764:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894359424/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320163.525831:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894359552:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320163.526037:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894359424:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767320163.535616:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320163.535631:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320163.535637:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894359424:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320163.538641:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894359552:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320164.356192:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320164.422954:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320165.380240:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320165.444532:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320166.404230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320166.469463:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320167.428690:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320167.497708:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320168.452256:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320168.517734:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320168.647879:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320168.647891:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320168.647903:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320168.647908:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320168.647912:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320168.647922:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5414 00000100:00080000:2.0:1767320168.647933:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320168.647940:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320168.647952:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320168.647986:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894359680/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320168.648075:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894359808:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320168.648282:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894359680:192.168.202.121@tcp:38:kworker.0 00000100:00080000:0.0:1767320168.653687:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320168.653706:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320168.653712:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894359680:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320168.664512:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894359808:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320169.477756:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320169.541652:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320170.500219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320170.567359:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320171.525091:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320171.589637:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320172.548812:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320172.612373:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320173.574180:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320173.636393:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320173.768405:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320173.768420:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320173.768423:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320173.768427:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320173.768432:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320173.768444:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5420 00000100:00080000:1.0:1767320173.768457:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320173.768465:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320173.768477:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320173.768522:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2300 x1853163894359936/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320173.768600:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894360064:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320173.768835:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894359936:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320173.778706:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894360064:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320173.778838:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320173.778849:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320173.778853:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894359936:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320174.596241:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320174.661174:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320175.620217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320175.684295:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320176.644225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320176.708727:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320177.668194:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320177.732760:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320178.692202:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320178.756349:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320178.884322:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320178.884332:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320178.884335:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320178.884339:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320178.884343:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320178.884364:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5425 00000100:00080000:2.0:1767320178.884375:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320178.884382:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767320178.884382:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320153/real 1767320153] req@ffff9cfe29109f80 x1853163894358784/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320178 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000008:00100000:2.0:1767320178.884392:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320178.884407:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe29109f80 x1853163894358784/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320178 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767320178.884420:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108380 x1853163894360192/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767320178.884423:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320178.884444:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767320178.884448:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894358784:192.168.202.121@tcp:250:kworker.0 00000100:00080000:2.0:1767320178.884461:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320178.884464:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1767320178.884466:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320178.884469:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5404 00000100:00100000:3.0:1767320178.884470:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894360192:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767320178.884472:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320178.884476:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:2.0:1767320178.884485:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910a680 x1853163894360448/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320178.884501:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320178.884523:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894360320:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320178.884554:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894360448:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767320178.893805:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320178.893820:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320178.893825:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894360192:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320178.894290:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894360320:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320179.716192:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320179.781501:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320180.740159:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320180.805117:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320181.764227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320181.830910:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320182.788429:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320182.856803:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320183.812217:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320183.876664:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320184.004218:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320184.004229:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320184.004231:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320184.004235:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320184.004239:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320184.004249:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5430 00000100:00080000:0.0:1767320184.004258:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320184.004264:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320184.004292:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320184.004324:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8e00 x1853163894360576/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320184.004380:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894360576:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320184.004425:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894360704:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320184.009808:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894360704:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767320184.010887:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320184.010896:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767320184.010901:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894360576:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320184.836340:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320184.903138:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320185.860222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320185.925457:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320186.884219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320186.948350:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320187.908209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320187.972605:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320188.932670:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320188.996246:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320189.124252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320189.124264:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320189.124267:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320189.124271:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320189.124275:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320189.124287:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5435 00000100:00080000:0.0:1767320189.124298:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320189.124304:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320189.124315:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320189.124349:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9f80 x1853163894360832/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320189.124528:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894360832:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320189.125055:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767320189.125066:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894360960:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767320189.127108:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320189.127119:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320189.127124:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894360832:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320189.127543:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894360960:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320189.957736:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320190.020485:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320190.980175:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320191.045649:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320192.007105:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320192.068534:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320193.031611:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320193.092625:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320194.052311:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320194.116665:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320194.244397:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320194.244408:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320194.244411:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320194.244415:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320194.244449:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320194.244460:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5440 00000100:00080000:3.0:1767320194.244471:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320194.244478:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320194.244490:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320194.244522:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894361088/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320194.244577:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894361088:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320194.244804:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894361216:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320194.247110:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894361216:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320194.247195:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320194.247202:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320194.247205:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894361088:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320195.076224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320195.140286:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320196.100231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320196.164826:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320197.124237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320197.188277:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320198.148207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320198.212717:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320199.172210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320199.237490:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320199.364181:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320199.364191:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320199.364194:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320199.364197:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320199.364202:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320199.364213:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5445 00000100:00080000:3.0:1767320199.364222:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320199.364229:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320199.364241:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320199.364275:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894361344/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320199.364344:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320199.364355:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894361472:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320199.364439:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894361344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320199.371950:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894361472:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320199.372059:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320199.372077:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320199.372109:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894361344:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320200.196214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320200.269378:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320201.220535:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320201.285225:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320202.244607:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320202.308374:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320203.268248:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320203.332367:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320203.461825:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320178/real 1767320178] req@ffff9cfe2910a680 x1853163894360448/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320203 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320203.461879:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe2910a680 x1853163894360448/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320203 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320203.461905:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320203.461940:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767320203.461945:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894360448:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767320203.462110:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320203.462117:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767320203.462120:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320203.462126:0:81663:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5430 00000100:00080000:3.0:1767320203.462138:0:81663:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320203.462146:0:81663:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767320203.462192:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894361600/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767320203.462219:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320203.462223:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320203.462225:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320203.462228:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5450 00000100:00080000:3.0:1767320203.462232:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320203.462236:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320203.462247:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320203.462259:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894361728/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320203.462374:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894361856:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320203.462758:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894361600:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767320203.462825:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894361728:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320203.467271:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894361856:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320203.467375:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320203.467383:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320203.467387:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894361728:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320204.292343:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320204.356601:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320205.316214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320205.380874:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320206.340423:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320206.404313:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320207.365155:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320207.428565:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320208.388272:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320208.461672:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320208.581965:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320208.581980:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320208.581983:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320208.581997:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320208.582002:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320208.582016:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5454 00000100:00080000:2.0:1767320208.582205:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320208.582656:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320208.582672:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320208.582715:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108a80 x1853163894361984/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320208.582807:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320208.582840:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894362112:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320208.583195:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894361984:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320208.591248:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894362112:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320208.591310:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320208.591318:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320208.591322:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894361984:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320209.413024:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320209.476575:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320210.436266:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320210.500554:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320211.460233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320211.524409:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320212.484256:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320212.549425:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320213.508239:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320213.572430:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320213.700705:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320213.700720:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320213.700723:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320213.700729:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320213.700735:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320213.700749:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5459 00000100:00080000:2.0:1767320213.700771:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320213.700781:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320213.700796:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320213.700845:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894362240/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320213.700965:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894362368:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320213.700966:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894362240:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767320213.709353:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320213.709382:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320213.709388:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894362240:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320213.715462:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894362368:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320214.533956:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320214.596311:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320215.556219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320215.623015:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320216.580222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320216.646828:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320217.606444:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320217.668492:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320218.628247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320218.706204:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320218.822064:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320218.822075:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320218.822078:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320218.822096:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320218.822101:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320218.822113:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5465 00000100:00080000:3.0:1767320218.822124:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320218.822154:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320218.822165:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320218.822198:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7100 x1853163894362496/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320218.822265:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894362496:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320218.822456:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894362624:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320218.830135:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320218.830151:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320218.830157:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894362496:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320218.831415:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894362624:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320219.652250:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320219.716328:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320220.678096:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320220.740403:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320221.702831:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320221.764333:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320222.724160:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320222.788949:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320223.748517:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320223.812402:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320223.940336:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320223.940345:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320223.940348:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320223.940351:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320223.940356:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320223.940366:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5470 00000100:00080000:2.0:1767320223.940386:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320223.940392:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320223.940403:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320223.940438:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108e00 x1853163894362752/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320223.940503:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894362752:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320223.940856:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894362880:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320223.952416:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320223.952434:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320223.952440:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894362752:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320223.953320:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894362880:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320224.772719:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320224.838999:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320225.797401:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320225.860806:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320226.821137:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320226.887941:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320227.844227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320227.909986:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767320228.036821:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320203/real 1767320203] req@ffff9cfe18fd7b80 x1853163894361600/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320228 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320228.036852:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd7b80 x1853163894361600/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320228 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320228.036883:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320228.043796:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767320228.043810:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894361600:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767320228.046323:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320228.046331:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767320228.046335:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320228.046345:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5454 00000100:00080000:3.0:1767320228.046356:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320228.046362:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767320228.046937:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5c00 x1853163894363008/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767320228.046969:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320228.046987:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320228.046989:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320228.046993:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5475 00000100:00080000:3.0:1767320228.046998:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320228.047002:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320228.047010:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320228.047023:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894363136/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320228.047115:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894363264:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320228.047747:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894363008:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767320228.047799:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894363136:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320228.049797:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894363264:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320228.054123:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320228.054138:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320228.054143:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894363136:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320228.868672:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320228.933610:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320229.892189:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320229.956336:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320230.918146:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320230.980463:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320231.940190:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320232.004245:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320232.965273:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320233.029032:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320233.156995:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320233.157008:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320233.157011:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320233.157016:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320233.157021:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320233.157033:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5479 00000100:00080000:3.0:1767320233.157046:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320233.157055:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320233.157070:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320233.157316:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5f80 x1853163894363392/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320233.157482:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894363520:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320233.160023:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894363392:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320233.167177:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894363520:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320233.170928:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320233.170948:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320233.170955:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894363392:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320233.988159:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320234.053020:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320235.012214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320235.076318:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320236.036218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320236.100472:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320237.060193:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320237.124411:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320238.084208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320238.148429:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320238.276408:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320238.276419:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320238.276423:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320238.276427:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320238.276431:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320238.276442:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5484 00000100:00080000:3.0:1767320238.276454:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320238.276462:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320238.276475:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320238.276670:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894363648/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320238.276955:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894363648:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320238.279020:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894363776:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320238.283483:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320238.283500:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320238.283506:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894363648:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320238.287359:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894363776:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320239.108186:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320239.174380:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320240.136816:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320240.200266:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320241.156300:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320241.221402:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320242.182152:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320242.244583:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320243.204687:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320243.274636:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320243.396219:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320243.396248:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320243.396251:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320243.396254:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320243.396258:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320243.396278:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5489 00000100:00080000:3.0:1767320243.396289:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320243.396296:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320243.396309:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320243.396340:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6680 x1853163894363904/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320243.396424:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894364032:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320243.397250:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894363904:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767320243.416428:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320243.416443:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320243.416449:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894363904:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320243.416597:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894364032:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320244.228260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320244.292272:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320245.252211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320245.317022:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320246.276422:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320246.343415:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320247.300707:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320247.365904:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320248.324202:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320248.390350:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320248.516564:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320248.516575:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320248.516578:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320248.516582:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320248.516586:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320248.516596:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5494 00000100:00080000:3.0:1767320248.516606:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320248.516633:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320248.516644:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320248.516678:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6d80 x1853163894364160/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320248.517138:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894364288:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320248.517266:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894364160:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767320248.526151:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320248.526177:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320248.526182:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894364160:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320248.530734:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894364288:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320249.348209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320249.412262:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320250.372347:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320250.436572:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320251.399984:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320251.460914:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320252.421183:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320252.489445:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320253.447893:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320253.509850:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320253.636235:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320228/real 1767320228] req@ffff9cfe18fd5c00 x1853163894363008/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320253 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767320253.636275:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd5c00 x1853163894363008/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320253 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767320253.636295:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320253.636320:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767320253.636324:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894363008:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767320253.636378:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320253.636384:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320253.636387:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320253.636392:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5479 00000100:00080000:0.0:1767320253.636412:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320253.636419:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767320253.636454:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894364416/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320253.636482:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320253.636486:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320253.636488:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320253.636492:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5499 00000100:00080000:0.0:1767320253.636496:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320253.636500:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320253.636508:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320253.636520:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9180 x1853163894364544/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320253.636579:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767320253.636601:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894364672:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320253.636827:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894364416:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767320253.636861:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894364544:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767320253.640908:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320253.640924:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767320253.640930:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894364544:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320253.641028:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894364672:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320254.469331:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320254.532468:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320255.492255:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320255.556540:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320256.522797:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320256.584797:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320257.540260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320257.604712:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320258.564301:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320258.629530:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320258.763126:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320258.763137:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320258.763140:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320258.763144:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320258.763148:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320258.763162:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5504 00000100:00080000:3.0:1767320258.763172:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320258.763189:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320258.763202:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320258.763264:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4000 x1853163894364800/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320258.763361:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894364800:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320258.763499:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320258.763509:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894364928:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320258.774140:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894364928:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320258.774227:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320258.774232:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320258.774235:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894364800:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320259.588432:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320259.666423:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320260.612214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320260.676242:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320261.636556:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320261.700417:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320262.660230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320262.725463:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320263.684332:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320263.749365:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320263.876287:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320263.876295:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320263.876298:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320263.876302:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320263.876319:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320263.876329:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5510 00000100:00080000:3.0:1767320263.876338:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320263.876346:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320263.876358:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320263.876399:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7800 x1853163894365056/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320263.876445:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894365056:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320263.876457:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894365184:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320263.891485:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894365184:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320263.901723:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320263.901739:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320263.901744:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894365056:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320264.709309:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320264.772379:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320265.732257:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320265.799606:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320266.756263:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320266.820564:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320267.781442:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320267.844499:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320268.804255:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320268.869923:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320268.996546:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320268.996562:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320268.996566:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320268.996570:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320268.996576:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320268.996589:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5515 00000100:00080000:2.0:1767320268.996602:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320268.996611:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320268.996626:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320268.996679:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894365312/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320268.996761:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894365440:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320268.997423:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894365312:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320269.004202:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894365440:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320269.009199:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320269.009221:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320269.009227:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894365312:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320269.833267:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320269.892355:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320270.852227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320270.916548:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320271.877778:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320271.941436:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320272.900302:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320272.965191:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320273.924854:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320273.988880:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320274.124578:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320274.124593:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320274.124598:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320274.124603:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320274.124614:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320274.124637:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5520 00000100:00080000:0.0:1767320274.124652:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320274.124660:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320274.124684:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320274.124733:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089faa00 x1853163894365568/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320274.124838:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894365696:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320274.124860:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894365568:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320274.132631:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894365696:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320274.132704:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320274.132714:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320274.132719:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894365568:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320274.949246:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320275.012560:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320275.975158:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320276.037385:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320276.996802:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320277.060557:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320278.021106:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320278.084389:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320278.212243:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320253/real 1767320253] req@ffff9cfe089fad80 x1853163894364416/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320278 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320278.212286:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fad80 x1853163894364416/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320278 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320278.212304:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320278.212323:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767320278.212326:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894364416:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767320278.212422:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320278.212428:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320278.212430:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320278.212435:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5504 00000100:00080000:0.0:1767320278.212444:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320278.212449:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767320278.212478:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa300 x1853163894365824/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320278.212500:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320278.212504:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320278.212505:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320278.212508:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5525 00000100:00080000:0.0:1767320278.212511:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320278.212515:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320278.212522:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320278.212530:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8700 x1853163894365952/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320278.212627:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894366080:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320278.212709:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894365824:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767320278.212758:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894365952:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767320278.233933:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320278.233950:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320278.233955:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894365952:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320278.234140:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894366080:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320279.044388:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320279.108384:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320280.068338:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320280.132370:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320281.092417:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320281.156437:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320282.116873:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320282.183212:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320283.140954:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320283.207891:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320283.332272:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320283.332284:0:81663:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320283.332287:0:81663:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320283.332291:0:81663:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320283.332295:0:81663:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320283.332306:0:81663:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5529 00000100:00080000:3.0:1767320283.332314:0:81663:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320283.332320:0:81663:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320283.332332:0:81663:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320283.332378:0:81663:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd6d80 x1853163894366208/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320283.332446:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320283.332464:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894366336:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320283.332763:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894366208:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320283.339895:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894366336:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320283.348907:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320283.348923:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320283.348929:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894366208:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320284.164368:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320284.228643:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320285.188220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320285.254635:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320286.212342:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320286.280620:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320287.236914:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320287.300297:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320288.260232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320288.324272:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320288.452346:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320288.452358:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320288.452361:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320288.452365:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320288.452371:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320288.452381:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5534 00000100:00080000:1.0:1767320288.452391:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320288.452398:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320288.452411:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320288.452449:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3800 x1853163894366464/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320288.452642:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894366592:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320288.452807:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894366464:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320288.467587:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894366592:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767320288.471918:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320288.471935:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320288.471941:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894366464:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320289.284233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320289.348409:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320290.308242:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320290.372287:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320291.332203:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320291.396959:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320292.356280:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320292.420230:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320293.380216:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320293.445025:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320293.572205:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320293.572216:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320293.572229:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320293.572253:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320293.572258:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320293.572269:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5539 00000100:00080000:1.0:1767320293.572281:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320293.572288:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320293.572311:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320293.572346:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0a80 x1853163894366720/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320293.572668:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894366720:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320293.574494:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894366848:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320293.580804:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894366848:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767320293.580901:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320293.580909:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320293.580914:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894366720:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320294.404453:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320294.468312:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320295.428255:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320295.494041:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320296.452232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320296.516388:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320297.476196:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320297.541273:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320298.500298:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320298.567562:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320298.692326:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320298.692336:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320298.692339:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320298.692343:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320298.692348:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320298.692357:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5544 00000100:00080000:3.0:1767320298.692366:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320298.692372:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320298.692394:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320298.692430:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4380 x1853163894366976/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320298.692492:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320298.692510:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894367104:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320298.692789:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894366976:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320298.704676:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894367104:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320298.708181:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320298.708197:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320298.708218:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894366976:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320299.525306:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320299.588314:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320300.548198:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320300.612410:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320301.572197:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320301.636273:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320302.598484:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320302.661572:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320303.620222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320303.684450:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320303.812222:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320278/real 1767320278] req@ffff9cfe089fa300 x1853163894365824/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320303 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320303.812255:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fa300 x1853163894365824/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320303 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320303.812275:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320303.812307:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767320303.812326:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894365824:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767320303.812790:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320303.812796:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320303.812799:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320303.812805:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5529 00000100:00080000:0.0:1767320303.812814:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320303.812820:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767320303.812853:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa680 x1853163894367232/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320303.812893:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320303.812897:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320303.812899:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320303.812903:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5550 00000100:00080000:0.0:1767320303.812908:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320303.812911:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320303.812920:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320303.812934:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8380 x1853163894367360/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320303.812998:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894367488:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320303.813219:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894367232:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767320303.813254:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894367360:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767320303.820222:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1767320303.820228:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894367488:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320303.820232:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320303.820239:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894367360:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320304.644303:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320304.708329:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320305.668262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320305.732971:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320306.692180:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320306.756537:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320307.717999:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320307.780506:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320308.740283:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320308.805682:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320308.933015:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320308.933025:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320308.933029:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320308.933032:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320308.933036:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320308.933046:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5555 00000100:00080000:3.0:1767320308.933057:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320308.933064:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320308.933075:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320308.933136:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4a80 x1853163894367616/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320308.934916:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894367616:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320308.935201:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894367744:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320308.945572:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320308.945587:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320308.945593:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894367616:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320308.948863:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894367744:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320309.764159:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320309.828499:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320310.788260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320310.852232:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320311.812203:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320311.876280:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320312.836649:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320312.901144:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320313.860221:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320313.924277:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320314.052195:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320314.052204:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320314.052224:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320314.052228:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320314.052231:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320314.052240:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5560 00000100:00080000:3.0:1767320314.052250:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320314.052257:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320314.052268:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320314.052300:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894367872/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320314.052365:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320314.052381:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894368000:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320314.052643:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894367872:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320314.064779:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894368000:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320314.064893:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320314.064899:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320314.064902:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894367872:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320314.884280:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320314.948877:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320315.908241:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320315.973060:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320316.932229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320316.996538:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320317.956398:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320318.022005:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320318.980229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320319.044682:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320319.172475:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320319.172483:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320319.172485:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320319.172488:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320319.172492:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320319.172499:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5565 00000100:00080000:3.0:1767320319.172507:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320319.172527:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320319.172536:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320319.172564:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894368128/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320319.172631:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320319.172642:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894368256:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320319.172934:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894368128:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320319.194564:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894368256:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320319.195172:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320319.195180:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320319.195185:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894368128:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320320.004226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320320.069117:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320321.028275:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320321.092430:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320322.052230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320322.120583:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320323.076529:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320323.140514:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320324.100172:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320324.164943:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320324.293515:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320324.293535:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320324.293538:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320324.293542:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320324.293546:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320324.293556:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5570 00000100:00080000:2.0:1767320324.293565:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320324.293572:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320324.293582:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320324.293622:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894368384/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320324.293700:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320324.293724:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894368512:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320324.294027:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894368384:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320324.305559:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894368512:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320324.313175:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320324.313191:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320324.313196:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894368384:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320325.124203:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320325.191942:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320326.148237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320326.212366:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320327.172226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320327.236537:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320328.196237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320328.260428:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320328.388376:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320303/real 1767320303] req@ffff9cfe089fa680 x1853163894367232/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320328 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767320328.388410:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fa680 x1853163894367232/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320328 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767320328.388429:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320328.388439:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767320328.388443:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894367232:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767320328.388761:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320328.388767:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767320328.388770:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320328.388775:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5555 00000100:00080000:3.0:1767320328.388783:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320328.388789:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767320328.388817:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894368640/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767320328.388850:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320328.388854:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320328.388856:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320328.388860:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5575 00000100:00080000:3.0:1767320328.388864:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320328.388867:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320328.388876:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320328.388889:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894368768/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320328.388942:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894368896:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320328.389171:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894368640:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767320328.389221:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894368768:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320328.390833:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894368896:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767320328.391181:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320328.391187:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320328.391191:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894368768:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320329.220397:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320329.286260:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320330.244222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320330.308453:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320331.268333:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320331.332591:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320332.294554:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320332.356322:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320333.316209:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320333.380300:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320333.508417:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320333.508428:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320333.508431:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320333.508435:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320333.508439:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320333.508450:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5579 00000100:00080000:2.0:1767320333.508460:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320333.508468:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320333.508479:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320333.508520:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910b100 x1853163894369024/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320333.508736:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894369024:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320333.508914:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894369152:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320333.519373:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894369152:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320333.520742:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320333.520753:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320333.520758:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894369024:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320334.340210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320334.404459:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320335.364164:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320335.429870:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320336.388226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320336.454972:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320337.413440:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320337.477687:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320338.436380:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320338.501785:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320338.628909:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320338.628920:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320338.628923:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320338.628927:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320338.628931:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320338.628941:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5584 00000100:00080000:2.0:1767320338.628951:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320338.628975:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320338.628986:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320338.629018:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910bb80 x1853163894369280/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320338.629558:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894369280:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320338.629824:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320338.629835:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894369408:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320338.643582:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1767320338.643590:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894369408:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320338.643596:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320338.643602:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894369280:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320339.460338:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320339.525004:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320340.484263:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320340.548304:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320341.508698:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320341.572801:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320342.533170:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320342.600001:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320343.556214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320343.620841:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320343.748446:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320343.748457:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320343.748460:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320343.748464:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320343.748468:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320343.748477:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5589 00000100:00080000:2.0:1767320343.748487:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320343.748494:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320343.748505:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320343.748550:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29108000 x1853163894369536/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320343.748625:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320343.748639:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894369664:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320343.749056:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894369536:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320343.751649:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894369664:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320343.752424:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320343.752433:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320343.752437:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894369536:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320344.580903:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320344.644299:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320345.605578:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320345.669136:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320346.628458:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320346.692432:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320347.652219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320347.716338:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320348.676227:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320348.740492:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320348.868292:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320348.868307:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320348.868311:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320348.868316:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320348.868347:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320348.868370:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5595 00000100:00080000:2.0:1767320348.868383:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320348.868392:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320348.868407:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320348.868447:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109c00 x1853163894369792/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320348.869159:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320348.869188:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894369920:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320348.869331:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894369792:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320348.871795:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894369920:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320348.871907:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320348.871914:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320348.871918:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894369792:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320349.700330:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320349.764588:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320350.724257:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320350.788923:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320351.749279:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320351.813983:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320352.773637:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320352.837002:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320353.796232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320353.860313:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320353.988479:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320328/real 1767320328] req@ffff9cfe18fd7480 x1853163894368640/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320353 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767320353.988526:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe18fd7480 x1853163894368640/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320353 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767320353.988546:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320353.988567:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767320353.988571:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894368640:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767320353.988705:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320353.988728:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767320353.988730:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320353.988736:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5579 00000100:00080000:1.0:1767320353.988745:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320353.988750:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767320353.988780:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2d80 x1853163894370048/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767320353.988804:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320353.988808:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320353.988810:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320353.988813:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5600 00000100:00080000:1.0:1767320353.988817:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320353.988822:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320353.988830:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320353.988843:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2680 x1853163894370176/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320353.989006:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894370048:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767320353.989112:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894370176:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320353.990047:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894370304:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320354.003217:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894370304:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767320354.004950:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320354.004963:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320354.004968:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894370176:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320354.820309:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320354.884848:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320355.844223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320355.908936:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320356.868679:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320356.933961:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320357.892215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320357.956417:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320358.916226:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320358.980473:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320359.108306:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320359.108317:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320359.108320:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320359.108324:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320359.108328:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320359.108338:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5605 00000100:00080000:1.0:1767320359.108348:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320359.108373:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320359.108384:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320359.108416:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1880 x1853163894370432/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320359.108493:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767320359.108510:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894370560:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320359.109270:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894370432:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320359.112762:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894370560:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320359.115310:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320359.115325:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320359.115330:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894370432:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320359.940191:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320360.008067:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320360.964212:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320361.028344:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320361.988225:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320362.052316:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320363.012279:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320363.076849:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320364.036360:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320364.100491:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320364.230150:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320364.230161:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320364.230164:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320364.230168:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320364.230172:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320364.230183:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5610 00000100:00080000:1.0:1767320364.230194:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320364.230201:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320364.230213:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320364.230248:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1500 x1853163894370688/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320364.230338:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894370816:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320364.230813:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894370688:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320364.237589:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894370816:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767320364.239835:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320364.239849:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320364.239854:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894370688:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320365.060247:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320365.124721:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320366.084808:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320366.150605:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320367.108490:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320367.173069:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320368.132410:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320368.197909:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320369.156260:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320369.221199:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320369.349681:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320369.349696:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320369.349699:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320369.349703:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320369.349709:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320369.349723:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5615 00000100:00080000:3.0:1767320369.349734:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320369.349743:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320369.349783:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320369.349828:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7480 x1853163894370944/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320369.349914:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320369.349938:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894371072:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320369.350017:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894370944:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320369.353409:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894371072:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320369.354515:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320369.354528:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320369.354533:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894370944:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320370.180775:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320370.244800:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320371.205159:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320371.271596:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320372.228297:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320372.292311:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320373.254534:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320373.317548:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320374.276359:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320374.340897:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320374.471400:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320374.471414:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320374.471417:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320374.471422:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320374.471428:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320374.471443:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5620 00000100:00080000:2.0:1767320374.471458:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320374.471467:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320374.471481:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320374.471533:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910a680 x1853163894371200/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320374.471615:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767320374.471635:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894371328:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320374.471766:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894371200:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320374.488803:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894371328:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1767320374.489814:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320374.489827:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:0.0:1767320374.489834:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894371200:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320375.300228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320375.365467:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320376.324273:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320376.392143:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320377.348609:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320377.416759:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320378.373318:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320378.436694:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767320378.564310:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320353/real 1767320353] req@ffff9cfe0f3d2d80 x1853163894370048/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320378 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767320378.564349:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d2d80 x1853163894370048/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320378 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1767320378.564373:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1767320378.564664:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:0.0:1767320378.564671:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894370048:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767320378.565833:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320378.565847:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767320378.565853:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320378.565865:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5605 00000100:00080000:1.0:1767320378.565880:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320378.565908:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767320378.565947:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1c00 x1853163894371456/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1767320378.565981:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320378.565986:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320378.565987:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320378.565992:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5625 00000100:00080000:1.0:1767320378.565997:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320378.566003:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320378.566116:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320378.566131:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0e00 x1853163894371584/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320378.566232:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894371456:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767320378.566894:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894371584:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320378.566961:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894371712:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767320378.579126:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320378.579141:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320378.579145:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894371712:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320378.579149:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894371584:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320379.396264:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320379.460283:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320380.420230:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320380.484620:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320381.444857:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320381.508267:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320382.468203:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320382.532450:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320383.492220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320383.556270:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320383.684262:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320383.684272:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320383.684276:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320383.684280:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320383.684285:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320383.684310:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5629 00000100:00080000:1.0:1767320383.684318:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320383.684325:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320383.684335:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320383.684378:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d3480 x1853163894371840/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320383.684420:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894371840:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320383.684441:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767320383.684453:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894371968:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767320383.695138:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320383.695154:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320383.695159:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894371840:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320383.698883:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894371968:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320384.518321:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320384.580608:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320385.541333:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320385.604927:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320386.564624:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320386.631510:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320387.589902:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320387.652914:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320388.612220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320388.676398:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320388.805113:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320388.805124:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320388.805127:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320388.805131:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320388.805135:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320388.805147:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5635 00000100:00080000:3.0:1767320388.805157:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320388.805177:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320388.805189:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320388.805225:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894372096/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320388.805333:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894372224:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320388.805968:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894372096:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320388.812428:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894372224:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320388.827375:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320388.827390:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320388.827395:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894372096:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320389.636172:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320389.701512:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320390.660252:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320390.724470:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320391.684223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320391.750969:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320392.708400:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320392.772622:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320393.733651:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320393.796376:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320393.924385:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320393.924426:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320393.924429:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320393.924433:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320393.924437:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320393.924447:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5640 00000100:00080000:3.0:1767320393.924457:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320393.924465:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320393.924497:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320393.924530:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894372352/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320393.924606:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894372352:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320393.924859:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894372480:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320393.931463:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894372480:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320393.931729:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320393.931736:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320393.931740:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894372352:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320394.761202:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320394.820354:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320395.780237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320395.845324:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320396.804501:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320396.868691:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320397.829104:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320397.892447:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320398.852868:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320398.916331:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320399.044233:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320399.044245:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320399.044248:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320399.044251:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320399.044255:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320399.044265:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5645 00000100:00080000:3.0:1767320399.044276:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320399.044304:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320399.044314:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320399.044351:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5880 x1853163894372608/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320399.049335:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320399.049375:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894372736:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320399.049416:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894372608:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320399.055025:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894372736:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320399.055130:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320399.055137:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320399.055141:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894372608:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320399.876264:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320399.942358:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320400.900198:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320400.964328:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320401.925512:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320401.989009:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320402.949306:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320403.012496:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767320403.144292:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320378/real 1767320378] req@ffff9cfe0f3d1c00 x1853163894371456/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320403 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320403.144357:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d1c00 x1853163894371456/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320403 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767320403.144376:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320403.144407:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767320403.144411:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894371456:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767320403.144461:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320403.144467:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320403.144470:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320403.144476:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5629 00000100:00080000:0.0:1767320403.144485:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320403.144491:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767320403.144525:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fbb80 x1853163894372864/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320403.144553:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320403.144557:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320403.144559:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320403.144563:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5650 00000100:00080000:0.0:1767320403.144567:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320403.144570:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320403.144609:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320403.144623:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9c00 x1853163894372992/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320403.144672:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894373120:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320403.144922:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894372864:192.168.202.121@tcp:250:kworker.0 00000100:00100000:1.0:1767320403.144964:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894372992:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767320403.148669:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320403.148685:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320403.148690:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894372992:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320403.149337:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894373120:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320403.972236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320404.037010:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320404.996269:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320405.060507:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320406.020239:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320406.086036:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320407.044272:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320407.108380:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320408.068296:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320408.132333:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320408.261658:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320408.262054:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320408.262058:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320408.262062:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320408.262067:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320408.262103:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5654 00000100:00080000:3.0:1767320408.262113:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320408.262120:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320408.262131:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320408.262171:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4e00 x1853163894373248/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320408.262262:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894373248:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320408.262429:0:2505:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767320408.262441:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894373376:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320408.267643:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320408.267679:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320408.267685:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894373248:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320408.285237:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894373376:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320409.092254:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320409.159206:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320410.117832:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320410.182354:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320411.140219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320411.209283:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320412.164224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320412.230454:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320413.190475:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320413.252447:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1767320413.380523:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320413.380533:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1767320413.380536:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320413.380540:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320413.380544:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320413.380569:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5659 00000100:00080000:3.0:1767320413.380579:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320413.380585:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320413.380597:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320413.380627:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd7b80 x1853163894373504/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320413.380701:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767320413.380718:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894373632:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320413.381254:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894373504:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320413.383293:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894373632:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320413.392816:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320413.392833:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320413.392850:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894373504:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320414.212607:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320414.276603:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320415.236590:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320415.303499:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320416.260233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320416.324310:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320417.284210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320417.348436:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320418.308220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320418.373500:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320418.500967:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320418.500977:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320418.500980:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320418.500984:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320418.500989:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320418.500999:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5664 00000100:00080000:0.0:1767320418.501008:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320418.501015:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320418.501025:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320418.501071:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa680 x1853163894373760/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320418.501191:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894373888:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320418.501362:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894373760:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767320418.510327:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320418.510344:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320418.510349:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894373760:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320418.510451:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894373888:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320419.332603:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320419.396842:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320420.356218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320420.422168:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320421.382416:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320421.445221:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320422.404474:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320422.470104:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320423.428385:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320423.492332:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320423.620230:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320423.620242:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320423.620257:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320423.620261:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320423.620265:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320423.620275:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5669 00000100:00080000:1.0:1767320423.620285:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320423.620291:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320423.620303:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320423.620336:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1c00 x1853163894374016/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320423.620409:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1767320423.620420:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894374144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320423.620581:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894374016:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767320423.636522:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320423.636538:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320423.636544:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894374016:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320423.636665:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894374144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320424.452364:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320424.519118:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320425.476211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320425.542723:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320426.500207:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320426.564394:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320427.524771:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320427.588356:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320428.548301:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320428.615316:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320428.740217:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320403/real 1767320403] req@ffff9cfe089fbb80 x1853163894372864/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320428 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767320428.740250:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fbb80 x1853163894372864/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320428 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1767320428.740282:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320428.740302:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:3.0:1767320428.740307:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894372864:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767320428.740433:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320428.740439:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320428.740443:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320428.740449:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5654 00000100:00080000:0.0:1767320428.740458:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320428.740465:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767320428.740489:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fa300 x1853163894374272/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1767320428.740513:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320428.740517:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320428.740519:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320428.740522:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5674 00000100:00080000:0.0:1767320428.740525:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320428.740528:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320428.740537:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320428.740547:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8700 x1853163894374400/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320428.740587:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767320428.740602:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894374528:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320428.741044:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894374272:192.168.202.121@tcp:250:kworker.0 00000100:00100000:3.0:1767320428.741124:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894374400:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320428.744319:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894374528:192.168.202.121@tcp:400:kworker.0 00000100:00080000:3.0:1767320428.744548:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320428.744554:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320428.744556:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894374400:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320429.572162:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320429.636651:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320430.596159:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320430.661845:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320431.620334:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320431.684531:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320432.644485:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320432.708629:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320433.668228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320433.732341:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320433.868898:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320433.868911:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320433.868913:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320433.868918:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320433.868923:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320433.868933:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5680 00000100:00080000:0.0:1767320433.868945:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320433.868952:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320433.868962:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320433.868998:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fad80 x1853163894374656/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320433.869113:0:2502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767320433.869133:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894374784:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320433.869168:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894374656:192.168.202.121@tcp:38:kworker.0 00000100:00080000:3.0:1767320433.877837:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1767320433.877854:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:3.0:1767320433.877859:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894374656:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320433.878042:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894374784:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320434.692339:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320434.758671:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320435.716237:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320435.780318:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320436.740342:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320436.804445:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320437.765973:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320437.828854:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320438.788192:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320438.853336:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320438.981190:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320438.981200:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320438.981203:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320438.981207:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320438.981211:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320438.981221:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5685 00000100:00080000:2.0:1767320438.981230:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320438.981236:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320438.981247:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320438.981277:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894374912/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320438.981343:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894375040:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320438.982017:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894374912:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320438.994525:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894375040:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320438.996770:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320438.996787:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320438.996806:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894374912:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320439.812210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320439.876320:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320440.836229:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320440.900405:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320441.860234:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320441.924328:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320442.884979:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320442.948537:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320443.908224:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320443.973483:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320444.100389:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320444.100400:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320444.100421:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320444.100426:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320444.100430:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320444.100440:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5690 00000100:00080000:1.0:1767320444.100450:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1767320444.100456:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320444.100467:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320444.100499:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0000 x1853163894375168/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320444.100591:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894375296:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320444.101096:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894375168:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767320444.106296:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320444.106313:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320444.106318:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894375168:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320444.106419:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894375296:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320444.932210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320444.996321:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320445.956218:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320446.026004:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320446.980268:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320447.044398:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320448.004234:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320448.069616:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320449.028240:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320449.094270:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320449.221909:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320449.221921:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320449.221924:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320449.221928:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320449.221933:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320449.221943:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5695 00000100:00080000:1.0:1767320449.221954:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1767320449.221961:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320449.221972:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320449.222008:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0000 x1853163894375424/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320449.222205:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894375424:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320449.222936:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894375552:192.168.202.121@tcp:400:kworker.0 00000100:00100000:0.0:1767320449.225951:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894375552:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767320449.226060:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320449.226066:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767320449.226070:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894375424:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320450.052840:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320450.116411:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320451.079756:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320451.140356:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320452.100238:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320452.164428:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320453.124219:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320453.194610:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320453.316351:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320428/real 1767320428] req@ffff9cfe089fa300 x1853163894374272/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320453 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767320453.316381:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089fa300 x1853163894374272/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320453 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767320453.316401:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320453.319843:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767320453.319874:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894374272:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767320453.319961:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320453.319967:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1767320453.319971:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320453.319978:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5680 00000100:00080000:1.0:1767320453.319988:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320453.319994:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:1.0:1767320453.320027:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0e00 x1853163894375680/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320453.320100:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894375680:192.168.202.121@tcp:250:kworker.0 00000100:00080000:1.0:1767320453.320234:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320453.320240:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320453.320242:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320453.320247:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5700 00000100:00080000:1.0:1767320453.320253:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1767320453.320257:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320453.320266:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320453.320279:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d2d80 x1853163894375808/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320453.321938:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894375808:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320453.323390:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1767320453.323411:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894375936:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767320453.325563:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320453.325600:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767320453.325605:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894375808:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320453.327303:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894375936:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320454.148288:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320454.213604:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320455.172518:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320455.236595:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320456.196330:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320456.261649:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320457.220233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320457.284536:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320458.245896:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320458.313486:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320458.436340:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320458.436351:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320458.436354:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320458.436357:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320458.436362:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320458.436372:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5704 00000100:00080000:2.0:1767320458.436382:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320458.436388:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320458.436404:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320458.436442:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109500 x1853163894376064/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320458.436581:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894376064:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320458.436752:0:2504:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767320458.436762:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894376192:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320458.448434:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894376192:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320458.448595:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320458.448602:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320458.448606:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894376064:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320459.268211:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320459.332567:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320460.292493:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320460.356436:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320461.316262:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320461.380518:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320462.340484:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320462.404487:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320463.364215:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320463.429054:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320463.558651:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320463.558660:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320463.558664:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320463.558668:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320463.558672:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320463.558682:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5709 00000100:00080000:2.0:1767320463.558692:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320463.558698:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320463.558709:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320463.558743:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe29109f80 x1853163894376320/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320463.558973:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894376448:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320463.559061:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894376320:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767320463.563348:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320463.563363:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320463.563368:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894376320:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320463.564215:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894376448:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320464.388231:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320464.452987:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320465.412397:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320465.480016:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320466.436188:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320466.504190:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320467.463108:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320467.526383:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320468.484208:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320468.550029:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320468.676789:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320468.676803:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320468.676806:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320468.676811:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320468.676817:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320468.676829:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5714 00000100:00080000:0.0:1767320468.676842:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320468.676850:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320468.676867:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320468.676914:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089faa00 x1853163894376576/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320468.676979:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894376576:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320468.677292:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894376704:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320468.686167:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320468.686198:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320468.686205:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894376576:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320468.687890:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894376704:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320469.508343:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320469.572702:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320470.533604:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320470.601641:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320471.556438:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320471.620378:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320472.582189:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320472.644523:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320473.604366:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320473.669455:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320473.801251:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320473.801267:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320473.801304:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320473.801309:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320473.801315:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320473.801328:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5720 00000100:00080000:0.0:1767320473.801343:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320473.801353:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320473.801368:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320473.801422:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9180 x1853163894376832/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320473.801528:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894376960:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320473.801528:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894376832:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767320473.806125:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320473.806150:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320473.806155:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894376832:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320473.807609:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894376960:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320474.628220:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320474.694548:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320475.653629:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320475.717670:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320476.676340:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320476.741029:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320477.700447:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320477.764868:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320478.724242:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320478.790559:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320478.916315:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320478.916328:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320478.916332:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320478.916336:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320478.916351:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320478.916365:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5725 00000100:00080000:0.0:1767320478.916379:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320478.916388:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320478.916406:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320478.916454:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089fb480 x1853163894377088/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320478.916554:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894377216:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320478.917514:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320453/real 1767320453] req@ffff9cfe0f3d0e00 x1853163894375680/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320478 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320478.917559:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe0f3d0e00 x1853163894375680/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320478 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767320478.917577:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894377088:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767320478.917640:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320478.917663:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:1.0:1767320478.917668:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894375680:192.168.202.121@tcp:250:kworker.0 00000100:00080000:0.0:1767320478.918937:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320478.918945:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1767320478.918950:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320478.918960:0:36:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5704 00000100:00080000:0.0:1767320478.918972:0:36:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320478.918980:0:36:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:0.0:1767320478.919021:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f8e00 x1853163894377344/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320478.919283:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894377344:192.168.202.121@tcp:250:kworker.0 00000100:00100000:0.0:1767320478.925215:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894377216:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767320478.925636:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320478.925644:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767320478.925648:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894377088:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320479.748411:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320479.812506:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320480.772294:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320480.836910:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320481.796691:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320481.863623:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320482.820273:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320482.884359:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320483.844214:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320483.908328:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1767320484.036524:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320484.036534:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1767320484.036537:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1767320484.036541:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1767320484.036546:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1767320484.036555:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5730 00000100:00080000:2.0:1767320484.036564:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1767320484.036571:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:2.0:1767320484.036582:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1767320484.036616:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe2910a680 x1853163894377472/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767320484.036687:0:2505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894377600:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1767320484.036876:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894377472:192.168.202.121@tcp:38:kworker.0 00000100:00080000:1.0:1767320484.041138:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320484.041151:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320484.041157:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe2910a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894377472:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320484.043368:0:2505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe29108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:9a586faf-b087-472d-9665-d3bc7d15b908:2505:1853163894377600:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320484.868213:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320484.932327:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320485.894655:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320485.958664:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320486.916193:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320486.980630:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320487.940179:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320488.004324:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320488.964210:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320489.029482:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320489.156519:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320489.156528:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320489.156531:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320489.156534:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320489.156538:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320489.156548:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5735 00000100:00080000:1.0:1767320489.156557:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320489.156564:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320489.156575:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320489.156608:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d0e00 x1853163894377728/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320489.156812:0:2502:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894377856:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320489.157333:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894377728:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320489.161278:0:2502:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a586faf-b087-472d-9665-d3bc7d15b908:2502:1853163894377856:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767320489.166635:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320489.166651:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767320489.166657:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894377728:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320489.988223:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320490.052365:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320491.012534:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320491.085374:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320492.036233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320492.100996:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320493.060378:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320493.124558:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320494.084178:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320494.148431:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1767320494.281333:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320494.281343:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1767320494.281346:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1767320494.281350:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1767320494.281354:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1767320494.281365:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5740 00000100:00080000:0.0:1767320494.281376:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1767320494.281383:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:0.0:1767320494.281410:0:36:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1767320494.281441:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe089f9f80 x1853163894377984/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767320494.281532:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894378112:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320494.281732:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894377984:192.168.202.121@tcp:38:kworker.0 00000100:00080000:2.0:1767320494.290552:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320494.290569:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767320494.290574:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894377984:192.168.202.121@tcp:38:kworker.0 00000100:00100000:0.0:1767320494.290685:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894378112:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320495.108222:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320495.172634:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320496.132851:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320496.196341:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320497.163287:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320497.222281:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320498.180236:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320498.244483:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320499.204228:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320499.268675:0:63296:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1767320499.396527:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320499.396537:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1767320499.396540:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1767320499.396544:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1767320499.396548:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1767320499.396557:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5745 00000100:00080000:1.0:1767320499.396567:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1767320499.396573:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:1.0:1767320499.396602:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1767320499.396634:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe0f3d1880 x1853163894378240/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767320499.396699:0:2503:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767320499.396711:0:2503:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894378368:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1767320499.397106:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894378240:192.168.202.121@tcp:38:kworker.0 00000100:00100000:1.0:1767320499.402420:0:2503:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a586faf-b087-472d-9665-d3bc7d15b908:2503:1853163894378368:192.168.202.121@tcp:400:kworker.0 00000100:00080000:2.0:1767320499.411936:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320499.411951:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:2.0:1767320499.411972:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe0f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894378240:192.168.202.121@tcp:38:kworker.0 00000100:00100000:3.0:1767320500.232540:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320500.305610:0:49629:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320501.252232:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320501.316411:0:63142:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320502.276286:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320502.341179:0:59093:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320503.300249:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:0.0:1767320503.364326:0:63143:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767320503.493043:0:2501:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320478/real 1767320478] req@ffff9cfe089f8e00 x1853163894377344/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320503 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767320503.493095:0:2501:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfe089f8e00 x1853163894377344/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1767320503 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1767320503.493114:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1767320503.493150:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.121@tcp failed (-110) 00000100:00100000:2.0:1767320503.493154:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe089f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894377344:192.168.202.121@tcp:250:kworker.0 00000100:00080000:3.0:1767320503.493311:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 568f9ca5-ad29-47fe-b5fc-4f260b03b168->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320503.493316:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1767320503.493319:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe276a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320503.493324:0:38:0:(import.c:509:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 192.168.202.121@tcp last attempt 5730 00000100:00080000:3.0:1767320503.493333:0:38:0:(import.c:588:import_select_connection()) MGC192.168.202.121@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320503.493339:0:38:0:(import.c:623:import_select_connection()) MGC192.168.202.121@tcp: import ffff9cfe276a0800 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000100:00100000:3.0:1767320503.493370:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd4700 x1853163894378496/t0(0) o250->MGC192.168.202.121@tcp@192.168.202.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1767320503.493415:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a586faf-b087-472d-9665-d3bc7d15b908->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1767320503.493419:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1767320503.493421:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1767320503.493425:0:38:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: connect to NID 192.168.202.121@tcp last attempt 5750 00000100:00080000:3.0:1767320503.493429:0:38:0:(import.c:588:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1767320503.493433:0:38:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffff9cfe08c17800: import ffff9cfe20395000 using connection 192.168.202.121@tcp/192.168.202.121@tcp 00000008:00100000:3.0:1767320503.493443:0:38:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34668544 ocd_grant: 2097152, lost: 0. 00000100:00100000:3.0:1767320503.493454:0:38:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfe18fd5180 x1853163894378624/t0(0) o38->lustre-MDT0000-mdc-ffff9cfe08c17800@192.168.202.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767320503.493633:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:568f9ca5-ad29-47fe-b5fc-4f260b03b168:2501:1853163894378496:192.168.202.121@tcp:250:kworker.0 00000100:00100000:2.0:1767320503.494009:0:2501:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894378624:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320503.494051:0:2504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894378752:192.168.202.121@tcp:400:kworker.0 00000100:00080000:1.0:1767320503.497468:0:2501:0:(import.c:65:import_set_state_nolock()) ffff9cfe20395000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1767320503.497480:0:2501:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.121@tcp failed (-19) 00000100:00100000:1.0:1767320503.497484:0:2501:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a586faf-b087-472d-9665-d3bc7d15b908:2501:1853163894378624:192.168.202.121@tcp:38:kworker.0 00000100:00100000:2.0:1767320503.497572:0:2504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9cfe18fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:9a586faf-b087-472d-9665-d3bc7d15b908:2504:1853163894378752:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1767320504.324463:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:3.0:1767320504.391982:0:42049:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320505.349935:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320505.414632:0:63840:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767320506.372233:0:84855:0:(client.c:2690:ptlrpc_set_wait()) set ffff9cfe04a21c00 going to sleep for 0 seconds 00010000:00010000:2.0:1767320506.436631:0:42048:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 48161 lines, 48161 kept, 0 dropped, 0 bad.